-- Logs begin at Wed 2022-08-17 10:41:58 UTC, end at Wed 2022-08-17 11:50:29 UTC. -- Aug 17 11:13:01.124121 dv-cinder-853450-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 11:13:01.132873 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 11:13:01 2022] *** Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: nodename: dv-cinder-853450-1-iscsi Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: machine: x86_64 Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: clock source: unix Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: pcre jit disabled Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: detected number of CPU cores: 4 Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: current working directory: / Aug 17 11:13:01.134869 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: detected binary path: /usr/bin/uwsgi-core Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: your processes number limit is 47680 Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: your memory page size is 4096 bytes Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: detected max file descriptor number: 2048 Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: lock engine: pthread robust mutexes Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: thunder lock: enabled Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 11:13:01.135460 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 11:13:01.173898 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: Python main interpreter initialized at 0x55601edd39c0 Aug 17 11:13:01.173898 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: python threads support enabled Aug 17 11:13:01.173898 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: your server socket listen backlog is limited to 100 connections Aug 17 11:13:01.173898 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: your mercy for graceful operations on workers is 90 seconds Aug 17 11:13:01.174246 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 11:13:01.174246 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: *** Operational MODE: preforking *** Aug 17 11:13:01.174498 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: *** uWSGI is running in multiple interpreter mode *** Aug 17 11:13:01.174498 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: spawned uWSGI master process (pid: 105460) Aug 17 11:13:01.174700 dv-cinder-853450-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 11:13:01.175196 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: spawned uWSGI worker 1 (pid: 105461, cores: 1) Aug 17 11:13:01.175538 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: spawned uWSGI worker 2 (pid: 105462, cores: 1) Aug 17 11:13:01.175695 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 11:13:01.818471 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 11:13:01.820646 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 11:13:02.878278 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:13:02.878278 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Aug 17 11:13:02.878988 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:13:02.878988 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Aug 17 11:13:02.879130 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:13:02.879130 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Aug 17 11:13:02.879130 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:13:02.879130 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Aug 17 11:13:05.308717 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:13:05.309280 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:13:05.309387 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:13:05.309757 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:13:05.310006 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:13:05.310389 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.310706 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.311028 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.311399 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.311717 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.312002 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.312336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.312648 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.312967 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.313202 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.313534 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.313856 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853450-1-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.314165 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.314347 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:13:05.314715 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.314798 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:13:05.314876 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.315047 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:13:05.315146 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.315341 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.315448 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:13:05.315652 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:13:05.315740 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.315946 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.316044 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.316353 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.316448 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.316849 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.316989 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317099 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317213 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317319 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317581 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317786 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.317911 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318091 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318217 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318389 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318550 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318703 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.318806 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319005 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319104 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319319 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319408 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853450-1-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319604 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319701 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.319987 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853450-1-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320084 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320294 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320382 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320597 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320693 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320901 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.320994 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.321223 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.321321 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.321547 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.321636 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.321904 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.322058 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.322220 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.322378 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.322868 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323000 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323171 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323271 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323489 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323576 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323800 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.323888 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324111 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324206 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324426 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324515 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324722 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.324817 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325021 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325107 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325323 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325457 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325659 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325782 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853450-1-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.325958 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326099 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326275 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326411 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326499 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326724 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.326836 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327153 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327247 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327467 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327560 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327776 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.327862 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328019 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328114 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328265 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328415 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328575 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328724 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.328886 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329188 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329366 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329510 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329711 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.329808 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330031 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330117 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330334 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330422 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330644 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330740 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.330954 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331048 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331257 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331391 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331567 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331674 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331871 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.331997 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332123 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332224 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332426 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332510 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332746 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.332833 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333065 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333159 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333372 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333539 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333635 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333769 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.333887 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334100 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334189 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334413 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334499 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334715 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.334808 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335028 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335116 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335340 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335427 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335641 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335744 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.335946 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336041 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336247 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336341 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336556 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336652 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336862 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.336955 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337162 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337248 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337407 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337552 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337721 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.337815 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338017 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338113 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338327 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338427 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338627 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338800 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.338926 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339051 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339226 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339363 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339518 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339700 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.339816 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340021 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340193 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340329 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340415 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340646 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340738 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.340967 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341066 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341261 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341368 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341586 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341683 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341883 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.341981 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342182 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342279 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342537 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342681 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342852 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.342947 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343101 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343187 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343403 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343489 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343707 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.343795 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344007 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344100 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344317 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344403 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344616 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344709 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.344916 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345003 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345214 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345299 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345538 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345642 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345839 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.345925 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346145 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346229 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346444 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346530 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346749 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.346841 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347137 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347357 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347453 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347660 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347746 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.347962 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348047 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348279 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348379 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348592 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348676 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348891 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.348977 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349190 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349277 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349525 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349633 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349812 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.349897 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350109 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350203 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350404 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350702 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.350788 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351010 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351098 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351316 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351409 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351623 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351756 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.351920 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352012 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352219 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352308 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352523 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352620 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352839 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.352937 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.353139 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.353235 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.353464 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.353624 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.353784 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.353939 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.354089 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.354267 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.354395 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.354593 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.354688 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.354907 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.354994 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.355213 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.355309 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.355520 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.355617 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.355842 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.355930 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.356146 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.356300 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.356432 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.356567 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.356735 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.356865 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.357045 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.357189 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.357351 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.357500 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.357683 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.357800 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.357990 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.358083 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.358320 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.358404 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:13:05.358629 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.358716 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.358933 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359032 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359240 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359326 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359558 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359643 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359867 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.359954 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360280 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360500 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360587 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360833 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.360921 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361135 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361219 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361470 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361561 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361786 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.361883 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362087 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362174 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362393 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362500 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362692 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.362780 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363005 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363091 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363325 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363420 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363627 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363714 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.363934 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364019 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364236 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364334 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364538 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364625 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364839 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.364926 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.365139 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.365618 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.365957 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366032 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366266 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366339 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366575 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366660 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366880 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.366954 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367190 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367306 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367495 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367631 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367802 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.367961 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368109 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368290 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368410 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368610 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368698 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.368928 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369003 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369243 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369326 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369594 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369675 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369909 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.369998 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370229 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370320 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370560 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370646 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370851 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.370935 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.371149 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.371233 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.371531 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.371616 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.371961 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372064 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372149 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372217 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372338 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372432 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372657 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372772 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.372944 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373033 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373244 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373337 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373588 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373727 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.373940 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374028 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374239 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374332 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374555 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374657 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374852 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.374940 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375150 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375249 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375453 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375554 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375753 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.375839 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376056 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376150 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376359 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376466 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376664 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376765 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.376977 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377071 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377285 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377381 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377618 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377717 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.377936 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378022 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378248 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378348 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378543 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378628 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378851 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.378939 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379163 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379264 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379473 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379559 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379773 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.379868 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380161 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380247 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380472 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380548 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380780 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.380878 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381075 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381152 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381376 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381489 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381699 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.381776 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382071 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382158 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382294 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382372 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382591 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382699 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382889 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.382975 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383201 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383277 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383497 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383581 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383794 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.383877 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384107 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384188 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384562 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384670 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384753 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.384991 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385067 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385321 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385410 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385673 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385750 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.385986 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386082 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386287 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386379 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386591 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386665 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386893 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.386986 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387194 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387294 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387496 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387588 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387796 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.387888 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388095 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388196 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388401 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388498 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388701 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.388801 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389001 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389099 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389320 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389409 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389659 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389835 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.389985 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390088 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390263 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390355 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390557 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390658 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390859 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.390955 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391187 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391280 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391493 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391593 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391805 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.391890 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392256 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392419 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392518 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392725 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.392819 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393027 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393132 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393328 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393444 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393653 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393752 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.393953 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394039 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394261 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394369 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394561 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394657 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.394956 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395167 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395263 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395478 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395578 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395779 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.395875 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396088 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396176 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396382 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396469 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396687 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396774 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.396997 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397093 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397313 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397399 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397640 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397740 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.397945 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398125 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398258 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398345 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398560 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398658 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398864 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.398950 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399167 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399255 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399464 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399564 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399761 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.399852 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400061 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400185 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400365 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400462 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400671 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400758 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.400971 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401067 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401283 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401377 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401616 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401704 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.401917 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402004 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402216 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402301 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402515 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402609 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402819 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.402905 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403131 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403235 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403432 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403517 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403746 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.403839 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404058 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404146 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404354 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404447 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404650 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.404746 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405025 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405116 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405331 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405436 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405654 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405755 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.405952 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406045 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406251 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406338 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406559 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406654 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406875 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.406960 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407175 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407262 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407481 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407575 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407790 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.407876 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408089 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408395 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408497 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408696 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408787 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.408996 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409083 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409308 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409403 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409637 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409725 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.409939 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410041 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410243 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410331 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410551 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410644 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410852 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.410938 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411153 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411243 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411469 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411555 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411769 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.411856 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412072 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412168 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412373 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412501 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412675 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.412771 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413015 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413324 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413414 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413654 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413911 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.413999 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414244 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414529 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414659 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414767 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414863 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.414955 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415161 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415257 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415464 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415563 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415784 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.415872 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416097 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416191 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416404 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416510 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416713 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.416882 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417015 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417101 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417314 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417401 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417638 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417740 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.417943 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418029 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418244 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418330 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418543 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418630 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418840 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.418934 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419141 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419227 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419436 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419522 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419737 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.419825 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420034 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420304 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420399 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420662 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420750 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.420960 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421046 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421263 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421361 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421591 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421681 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421909 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.421998 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422210 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422298 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422509 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422595 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422807 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.422893 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423203 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423435 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423531 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423733 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.423821 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424060 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424161 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424374 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424524 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424680 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424770 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.424989 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425084 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425283 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425368 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425617 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425717 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.425915 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426010 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426211 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426299 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426507 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426600 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426809 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.426904 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427109 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427196 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427405 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427490 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427707 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.427808 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428009 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428094 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428308 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428401 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428608 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428703 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428901 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.428996 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429204 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429290 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429529 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429633 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429838 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.429923 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430142 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430239 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430444 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430531 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430740 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.430827 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431043 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431139 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431343 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431437 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431637 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431724 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.431936 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432038 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432228 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432315 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432536 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432661 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432902 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.432998 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433203 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433289 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433527 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433624 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433829 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.433917 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434127 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434212 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434425 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434511 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434732 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.434820 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435032 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435117 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435329 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435415 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435625 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435713 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.435924 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436017 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436260 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436363 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436557 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436647 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436857 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.436944 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437164 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437258 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437492 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437593 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437792 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.437880 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438095 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438190 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438388 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438510 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438683 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438771 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.438979 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439076 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439278 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439373 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439571 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439658 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439865 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.439961 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440160 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440254 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440460 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440547 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440755 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.440844 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441065 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441152 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441363 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441493 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441682 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441773 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.441980 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442076 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442273 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442359 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442579 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442668 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442884 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.442979 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443190 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443285 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443510 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443598 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443813 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.443899 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444119 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444233 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444422 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444508 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444726 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.444860 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445027 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445122 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445323 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445464 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445652 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445743 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.445954 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446051 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446256 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446350 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446550 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446643 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446845 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.446952 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.447147 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.447241 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.447784 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.447884 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448095 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448184 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448398 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448487 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448704 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.448790 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449009 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449106 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449326 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449412 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449666 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449765 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.449961 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450049 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450267 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450353 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450573 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450667 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450877 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.450973 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.451185 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.451273 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.451490 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.451591 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.451849 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452007 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452126 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452231 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452454 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452602 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452732 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.452949 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453084 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453280 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453415 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453592 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453667 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.453946 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454092 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454222 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454328 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454544 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454677 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454844 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.454978 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455140 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455293 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455412 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455508 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455738 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.455883 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456146 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456294 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456401 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456486 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456737 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.456870 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457032 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457179 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457328 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457446 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457643 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457753 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.457950 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458057 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458252 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458345 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458546 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458638 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458865 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.458965 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459182 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459275 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459490 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459582 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459803 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.459908 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460104 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460205 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460396 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460488 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460700 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.460793 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461009 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461107 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461306 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461397 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461617 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461743 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.461915 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462028 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462221 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462329 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462516 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462604 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462827 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.462930 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463231 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463346 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463533 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463623 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463832 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.463936 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464137 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464237 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464445 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464542 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464758 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.464854 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465070 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465181 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465367 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465484 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465731 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.465818 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466029 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466127 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466334 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466422 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466635 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466761 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.466948 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467038 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467260 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467349 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467607 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467714 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.467915 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468006 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468234 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468329 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468514 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468602 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468817 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.468907 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469118 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469206 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469442 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469570 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469760 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.469859 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470160 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470259 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470465 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470553 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470765 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.470865 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471193 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471387 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471475 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471684 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471794 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.471986 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472077 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472282 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472370 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472582 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472680 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472895 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.472996 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473196 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473309 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473522 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473629 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473860 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.473970 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474122 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474219 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474417 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474515 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474716 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.474811 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475027 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475115 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475323 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475420 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475633 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475729 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.475936 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476024 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476250 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476340 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476563 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476661 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476860 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.476979 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477177 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477288 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477502 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477634 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477802 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.477959 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478103 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478263 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478400 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478566 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478735 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.478876 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479035 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479178 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479347 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479480 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479670 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479802 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.479997 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480086 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480300 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480388 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480628 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480765 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.480947 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481035 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481259 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481346 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481580 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481683 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481899 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.481992 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482195 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482282 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482492 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482581 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482794 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.482882 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483111 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483199 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483410 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483501 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483707 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.483804 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484029 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484118 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484337 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484428 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484638 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484737 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.484933 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485029 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485233 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485320 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485556 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485658 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485872 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.485975 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486173 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486262 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486470 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486558 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486768 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.486864 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487063 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487152 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487399 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487494 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487695 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.487863 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488014 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488103 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488315 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488404 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488628 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488717 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.488936 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489023 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489233 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489321 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489561 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489652 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489863 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.489953 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490162 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490250 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490463 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490552 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490766 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.490852 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491063 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491151 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491361 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491451 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491660 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491748 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.491965 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492069 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492264 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492473 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492581 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492795 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.492884 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493200 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493408 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493547 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493736 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.493825 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494043 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494133 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494349 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494436 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494653 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494749 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.494956 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495047 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495260 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495389 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495559 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495657 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495879 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.495968 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496186 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496275 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496497 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496604 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496813 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.496901 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497120 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497214 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497441 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497546 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497750 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.497839 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498052 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498159 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498361 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498451 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498736 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.498840 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499036 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499341 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499438 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499648 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499736 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.499958 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500046 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500260 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500367 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500562 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500664 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500868 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.500965 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501495 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501599 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501798 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.501896 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502103 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502194 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502406 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502493 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502720 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.502808 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503033 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503121 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503342 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503436 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503647 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503753 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.503950 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504039 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504257 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504353 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504560 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504758 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.504869 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505066 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505217 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505387 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505572 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505727 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.505825 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506041 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506130 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506347 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506444 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506656 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506745 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.506978 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507066 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507278 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507375 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507576 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507665 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507875 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.507965 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508174 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508272 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508470 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508560 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508777 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.508864 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509078 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509167 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509371 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509478 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509716 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.509805 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510023 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510122 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510329 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510543 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510632 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510889 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.510987 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.511199 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.511431 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.511520 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.511745 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.511841 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512071 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512160 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512392 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512481 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512704 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.512805 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513004 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513094 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513302 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513389 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513635 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513738 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.513937 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514025 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514234 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514348 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514584 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514686 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514889 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.514977 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515192 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515280 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515497 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515632 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515801 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.515890 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516096 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516198 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516407 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516496 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516704 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.516791 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517000 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517235 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517332 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517608 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517700 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.517904 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518027 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518200 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518302 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518497 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518586 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518794 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.518882 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519097 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519187 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519394 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519482 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519694 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519791 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.519997 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520086 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520296 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520393 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520591 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520687 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520890 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.520980 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521183 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521271 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521516 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521607 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521814 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.521911 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522111 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522234 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522418 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522521 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522717 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.522806 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523032 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523121 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523331 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523498 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523635 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523765 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.523933 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524020 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524241 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524338 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524541 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524778 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.524866 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525103 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525191 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525414 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525522 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525751 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.525838 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526053 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526158 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526357 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526453 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526652 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526740 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.526949 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527047 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527250 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527337 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527555 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527652 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527855 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.527952 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528156 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528251 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528456 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528543 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528757 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.528854 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529061 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529157 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529365 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529517 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529693 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.529784 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530029 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530124 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530334 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530430 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530637 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530727 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.530942 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531032 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531246 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531480 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531578 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531808 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.531898 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532123 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532218 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532451 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532551 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532763 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.532850 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533068 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533156 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533371 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533479 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533697 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.533798 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534000 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534095 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534306 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534396 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534608 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534702 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.534914 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535003 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535218 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535307 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535523 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535622 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535821 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.535918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536127 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536217 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536434 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536521 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536745 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.536846 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537047 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537135 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537350 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537458 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537685 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537791 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.537991 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538080 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538296 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538392 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538613 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538712 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.538913 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539001 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539234 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539323 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539547 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539636 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539861 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.539950 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540172 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540260 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540469 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540557 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540768 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.540857 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541067 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541164 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541368 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541498 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541702 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.541802 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542002 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542108 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542299 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542433 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542596 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542685 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542898 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.542995 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543199 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543308 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543497 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543625 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543793 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.543972 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544091 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544247 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544391 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544564 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544685 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544884 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.544981 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545194 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545282 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545549 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545666 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545878 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.545976 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546202 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546299 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546531 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546628 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546842 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.546932 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547129 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547217 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547425 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547524 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547722 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.547811 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548018 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548123 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548318 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548415 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548634 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548723 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.548939 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549049 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549241 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549372 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549564 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549717 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.549871 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550018 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550170 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550322 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550471 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550635 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550770 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.550948 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551071 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551256 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551358 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551557 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551651 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551888 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.551980 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552190 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552278 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552495 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552590 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552798 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.552886 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553098 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553188 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553397 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553512 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553717 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.553806 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554018 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554106 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554315 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554412 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554612 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554700 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554910 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.554998 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555226 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555322 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555537 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555625 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555849 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.555946 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556155 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556261 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556458 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556553 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556768 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.556859 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557069 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557165 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557369 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557474 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557697 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.557785 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558002 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558140 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558304 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558424 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558605 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558692 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.558956 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559060 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559213 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559301 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559517 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559616 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559821 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.559911 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560127 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560216 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560428 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560528 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560743 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.560840 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561059 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561163 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561381 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561535 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561726 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.561814 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562037 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562127 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562353 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562444 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562661 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562747 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.562964 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.563051 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.563262 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.563357 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.563499 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:13:05.563588 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.563865 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.564168 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.564474 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.564778 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.565085 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.565388 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.565714 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.566023 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.566331 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.566654 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.566972 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.567276 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.567593 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.567911 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.568247 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.568553 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.568891 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.569212 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.569555 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.569862 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.570160 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:13:05.570397 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:13:05.716543 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Registered counter for database nova_api Aug 17 11:13:05.722762 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Registered counter for database nova_api Aug 17 11:13:05.738400 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.741892 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.745854 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.748196 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.800314 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.context [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3887d9d-dee7-43d6-9d53-02c47e9236a8(cell1) {{(pid=105462) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 11:13:05.801817 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.context [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3887d9d-dee7-43d6-9d53-02c47e9236a8(cell1) {{(pid=105461) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 11:13:05.804218 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:13:05.804693 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:13:05.805615 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:13:05.806085 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:13:05.806286 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:13:05.806981 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:13:05.807423 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:13:05.807639 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:13:05.808354 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:13:05.808794 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:13:05.809473 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:13:05.810763 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:13:05.811452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Registered counter for database nova_cell0 Aug 17 11:13:05.812764 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Registered counter for database nova_cell0 Aug 17 11:13:05.816977 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Registered counter for database nova_cell1 Aug 17 11:13:05.818045 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Registered counter for database nova_cell1 Aug 17 11:13:05.825475 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.827226 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.828798 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.832524 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.833697 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.834360 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.835160 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.971557 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.977274 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Registered counter for database nova_cell0 Aug 17 11:13:05.980611 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Registered counter for database nova_cell0 Aug 17 11:13:05.987245 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.991195 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:13:05.992932 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:05.996086 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:13:06.327588 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:13:06.328334 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:13:06.334779 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:13:06.335486 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:13:06.670548 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:13:06.672964 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:13:06.676502 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:13:06.678904 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:13:06.681748 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55601edd39c0 pid: 105462 (default app) Aug 17 11:13:06.683803 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:13:06.684097 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55601edd39c0 pid: 105461 (default app) Aug 17 11:13:06.684982 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-486100ad-57f8-458c-91c9-4e195c52c341 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 17 11:13:06.685405 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Wed Aug 17 11:13:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:23.784000 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:23.785205 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Aug 17 11:14:23.785625 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:23.796667 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:23.798066 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:23.799549 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell1:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:23.800422 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:24.630933 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-3451885e-037b-430a-ba08-89b5a9e922ac admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:24.663449 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-3451885e-037b-430a-ba08-89b5a9e922ac admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.871876 Aug 17 11:14:24.664419 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 11:14:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:26.954425 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:26.955512 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-601e70ff-c00a-424c-8ff9-febc0e7f1f90 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 17 11:14:26.955913 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 2/4] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:27.401495 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-dbaa735b-d580-4137-b21f-faaefd281dbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:27.421794 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:14:27.421794 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: warnings.warn(msg) Aug 17 11:14:27.450545 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-dbaa735b-d580-4137-b21f-faaefd281dbc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488326 Aug 17 11:14:27.451102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 3/5] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:14:27.662787 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-b19909fe-fca1-411e-9450-a7f3ccef9aaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:27.667497 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:14:27.667497 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:14:27.670475 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:27.671286 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:27.672242 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell1:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:27.672903 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:27.738075 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-b19909fe-fca1-411e-9450-a7f3ccef9aaf admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278429 Aug 17 11:14:27.738966 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 3/6] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 11:14:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:30.062181 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-dbaa735b-d580-4137-b21f-faaefd281dbc admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:30.063198 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-dbaa735b-d580-4137-b21f-faaefd281dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 17 11:14:30.063598 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 4/7] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:30.707183 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-0717a2ce-e193-49df-8616-2bec6aa8fc78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "id": "d1", "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:30.727330 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:14:30.727330 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:14:30.747887 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-0717a2ce-e193-49df-8616-2bec6aa8fc78 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677926 Aug 17 11:14:30.748432 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 4/8] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:14:30.760574 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-13bf7139-fdb0-454a-8315-9ab8feb2a5c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:30.763633 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:14:30.763633 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: warnings.warn(msg) Aug 17 11:14:30.798907 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-13bf7139-fdb0-454a-8315-9ab8feb2a5c7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042038 Aug 17 11:14:30.799683 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 5/9] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 11:14:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:33.167700 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-0717a2ce-e193-49df-8616-2bec6aa8fc78 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:33.168807 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-0717a2ce-e193-49df-8616-2bec6aa8fc78 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 17 11:14:33.169217 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:33.513355 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ff3a03ff-7364-4e8b-a595-93e7b477de8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "id": "d2", "swap": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:33.532653 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ff3a03ff-7364-4e8b-a595-93e7b477de8c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.357375 Aug 17 11:14:33.533189 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 6/11] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:14:33.545402 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-6944546b-4bef-4942-ac45-e0ef4c9908bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:33.571007 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-6944546b-4bef-4942-ac45-e0ef4c9908bd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029395 Aug 17 11:14:33.571540 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 6/12] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 11:14:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:14:35.861940 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ff3a03ff-7364-4e8b-a595-93e7b477de8c admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:35.863860 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ff3a03ff-7364-4e8b-a595-93e7b477de8c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002696 Aug 17 11:14:35.864356 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 7/13] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:36.329554 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-17559f37-0533-467f-b18a-1195142757d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "ram": 2048, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:36.349722 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-17559f37-0533-467f-b18a-1195142757d6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478869 Aug 17 11:14:36.350272 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 7/14] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:14:36.362223 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-95744784-7910-4621-990d-6dec50a6f792 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:36.386364 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-95744784-7910-4621-990d-6dec50a6f792 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027703 Aug 17 11:14:36.387094 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 8/15] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 11:14:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:14:38.693453 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-17559f37-0533-467f-b18a-1195142757d6 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:38.694757 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-17559f37-0533-467f-b18a-1195142757d6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Aug 17 11:14:38.695444 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 8/16] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:39.129883 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "id": "d4"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:39.150586 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448490 Aug 17 11:14:39.151229 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 9/17] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:14:39.163349 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-f7ac1564-4c4f-42cb-9559-49e1a052b002 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:39.189287 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-f7ac1564-4c4f-42cb-9559-49e1a052b002 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029533 Aug 17 11:14:39.197845 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 9/18] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 11:14:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:41.573584 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:41.574553 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 17 11:14:41.574993 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 10/19] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:42.064160 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-d5a5fb5a-152b-4ee9-8369-72f48d05333c admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:42.093128 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-d5a5fb5a-152b-4ee9-8369-72f48d05333c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.511679 Aug 17 11:14:42.093861 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 10/20] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 11:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:14:44.431014 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:44.432214 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-743a881f-29f0-4ed7-ba85-937078b11d78 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Aug 17 11:14:44.432758 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 11/21] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:44.883515 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5323652f-5760-4421-92b0-9f97635830d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:44.908597 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5323652f-5760-4421-92b0-9f97635830d1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468190 Aug 17 11:14:44.909394 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 11/22] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:14:44.924518 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-015426cd-867a-4fc7-bdfa-8f0917f0c833 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:44.952584 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-015426cd-867a-4fc7-bdfa-8f0917f0c833 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032899 Aug 17 11:14:44.953497 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 12/23] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 11:14:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:47.231006 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5323652f-5760-4421-92b0-9f97635830d1 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:47.232116 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5323652f-5760-4421-92b0-9f97635830d1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 17 11:14:47.232522 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:47.634681 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-120844db-1d80-46db-bd1e-fd4e1b662097 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "name": "m1.small", "ram": 2048, "vcpus": 1, "swap": 0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:47.655278 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-120844db-1d80-46db-bd1e-fd4e1b662097 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416656 Aug 17 11:14:47.655823 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 13/25] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:14:47.668928 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-af228948-67f1-4522-abb6-259dacadf9fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:47.694159 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-af228948-67f1-4522-abb6-259dacadf9fa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028935 Aug 17 11:14:47.694737 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 13/26] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 11:14:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:50.034377 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-120844db-1d80-46db-bd1e-fd4e1b662097 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:50.035390 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-120844db-1d80-46db-bd1e-fd4e1b662097 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 17 11:14:50.035792 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:50.457348 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-cbce5475-fe65-49ab-b15d-13ec46227f8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:50.478206 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-cbce5475-fe65-49ab-b15d-13ec46227f8c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436410 Aug 17 11:14:50.479169 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 14/28] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:14:50.491235 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e391c7e3-bfc5-4b60-a81a-6ffc98512bab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:50.516251 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e391c7e3-bfc5-4b60-a81a-6ffc98512bab admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028855 Aug 17 11:14:50.516814 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 15/29] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 11:14:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:14:52.865782 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-cbce5475-fe65-49ab-b15d-13ec46227f8c admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:52.866888 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-cbce5475-fe65-49ab-b15d-13ec46227f8c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 17 11:14:52.867314 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:53.323102 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-36f983f1-d3b9-4272-842d-285a8a585ee5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:53.345361 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-36f983f1-d3b9-4272-842d-285a8a585ee5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472003 Aug 17 11:14:53.346240 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 16/31] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:14:53.358502 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-75350ea1-c813-4d8d-9ca1-dceef29c559c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:53.386068 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-75350ea1-c813-4d8d-9ca1-dceef29c559c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031410 Aug 17 11:14:53.386945 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 16/32] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 11:14:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:14:55.720093 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-36f983f1-d3b9-4272-842d-285a8a585ee5 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:14:55.721775 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-36f983f1-d3b9-4272-842d-285a8a585ee5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Aug 17 11:14:55.722420 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 17/33] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:14:56.158301 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:56.178785 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449865 Aug 17 11:14:56.179435 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 17/34] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 11:14:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:14:56.191565 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-608fc9f1-c108-4a43-886d-478d0c4d65e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:14:56.200257 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:56.223234 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-608fc9f1-c108-4a43-886d-478d0c4d65e7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035385 Aug 17 11:14:56.237660 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 18/35] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 11:14:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:15:14.898158 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:14.899597 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 17 11:15:14.900302 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 18/36] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:15.323592 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-a0104345-01a0-4544-ae6f-62150e602c53 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:15.341886 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-a0104345-01a0-4544-ae6f-62150e602c53 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.435035 Aug 17 11:15:15.342422 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 11:15:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:16.427178 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:16.428453 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-afddc05c-6df3-46c8-83f7-ac2c4db301c5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Aug 17 11:15:16.428901 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 19/38] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:16.971828 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ffa2a795-3944-4aea-b052-ad7252fcaa7f admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:16.977572 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-ffa2a795-3944-4aea-b052-ad7252fcaa7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ffa2a795-3944-4aea-b052-ad7252fcaa7f admin admin] Request method failure captured: Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Host: 10.222.0.15 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_M3E7ccXbGO_H1uxTvpZjmJ7BXYU7vOx-lB56qYbHwZtplnhbW1RL6T4bnItvq2lOBx029cVuxMWAB04rKpBslFrrOReNhJsPRFIW6V9LKLYE8kCDY07jwRz5XbZfxX_nmMNN3ZNaeudMIZmp_euc8gptr2PKohJ2weO4mQK7MeXGRo Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 17 11:15:16.980869 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User: admin Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: method: > Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: exception: Flavor 42 could not be found. Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: action_args: {'id': '42'} Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:16.982503 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:16.983480 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:16.985170 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ffa2a795-3944-4aea-b052-ad7252fcaa7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:16.986507 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ffa2a795-3944-4aea-b052-ad7252fcaa7f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.416979 Aug 17 11:15:16.986507 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 20/39] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 11:15:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 11:15:16.992153 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8218515d-7acb-4291-8405-f5c8f6f4608f admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:16.996382 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:17.015853 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8218515d-7acb-4291-8405-f5c8f6f4608f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027344 Aug 17 11:15:17.016371 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:17.026354 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-2581131d-b8d2-43ca-8943-f86e8b398c1d admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:17.050093 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-2581131d-b8d2-43ca-8943-f86e8b398c1d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027332 Aug 17 11:15:17.050598 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:17.060257 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-99a37006-1db5-4d1a-9b61-c6fb549c8679 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:17.066945 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-99a37006-1db5-4d1a-9b61-c6fb549c8679 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-99a37006-1db5-4d1a-9b61-c6fb549c8679 admin admin] Request method failure captured: Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept: application/json Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Connection: keep-alive Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Content-Length: 0 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABi_M3E7ccXbGO_H1uxTvpZjmJ7BXYU7vOx-lB56qYbHwZtplnhbW1RL6T4bnItvq2lOBx029cVuxMWAB04rKpBslFrrOReNhJsPRFIW6V9LKLYE8kCDY07jwRz5XbZfxX_nmMNN3ZNaeudMIZmp_euc8gptr2PKohJ2weO4mQK7MeXGRo Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Aug 17 11:15:17.070327 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant: admin Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User: admin Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Name: admin Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: method: > Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: exception: Flavor 42 could not be found. Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: action_args: {'id': '42'} Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:17.072181 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:17.073258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:17.074544 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-99a37006-1db5-4d1a-9b61-c6fb549c8679 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:17.075747 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-99a37006-1db5-4d1a-9b61-c6fb549c8679 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015036 Aug 17 11:15:17.075747 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 21/42] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 11:15:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:18.060000 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-2581131d-b8d2-43ca-8943-f86e8b398c1d admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:18.061004 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-2581131d-b8d2-43ca-8943-f86e8b398c1d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 17 11:15:18.061394 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 22/43] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:18.617393 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-3e5310a4-8671-4c2a-aa66-31620e61bef2 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:18.624966 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-3e5310a4-8671-4c2a-aa66-31620e61bef2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-3e5310a4-8671-4c2a-aa66-31620e61bef2 admin admin] Request method failure captured: Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept: application/json Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Connection: keep-alive Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Content-Length: 0 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABi_M3FznuBy76b1jmWPJELRRL29tH5G6aNYQwG8qQU_RG391GdAWAis3ukKEV4e993-xO9HYbpRX65leIbgVysmx9lhPoimTief2BhYKfJqfnNIzkENGzkSciHjbFhvPvgeW4iB7Q04AKJfEdZvQt4yUzhfoigX4LDCyY8c44KzrNuh3U Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Aug 17 11:15:18.626491 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant: admin Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User: admin Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Name: admin Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: method: > Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: exception: Flavor 84 could not be found. Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: action_args: {'id': '84'} Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:18.627918 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:18.628694 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.630052 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-3e5310a4-8671-4c2a-aa66-31620e61bef2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:18.631342 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-3e5310a4-8671-4c2a-aa66-31620e61bef2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.430401 Aug 17 11:15:18.631342 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 11:15:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:18.637953 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-ef00db33-e2d7-4e6f-b1c2-efcf054c3860 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:18.653407 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-ef00db33-e2d7-4e6f-b1c2-efcf054c3860 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019094 Aug 17 11:15:18.654326 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:18.663604 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8900b294-298d-4e98-81f1-531aedb20e86 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:18.678978 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8900b294-298d-4e98-81f1-531aedb20e86 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018893 Aug 17 11:15:18.679497 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:18.688699 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5dee8dd4-843a-4f20-ae74-c9cd09b40dcf admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:18.694226 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-5dee8dd4-843a-4f20-ae74-c9cd09b40dcf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5dee8dd4-843a-4f20-ae74-c9cd09b40dcf admin admin] Request method failure captured: Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Host: 10.222.0.15 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_M3FznuBy76b1jmWPJELRRL29tH5G6aNYQwG8qQU_RG391GdAWAis3ukKEV4e993-xO9HYbpRX65leIbgVysmx9lhPoimTief2BhYKfJqfnNIzkENGzkSciHjbFhvPvgeW4iB7Q04AKJfEdZvQt4yUzhfoigX4LDCyY8c44KzrNuh3U Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 17 11:15:18.695759 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User: admin Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: method: > Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: exception: Flavor 84 could not be found. Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: action_args: {'id': '84'} Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:18.697360 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:18.698336 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:18.699452 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-5dee8dd4-843a-4f20-ae74-c9cd09b40dcf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:18.700420 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-5dee8dd4-843a-4f20-ae74-c9cd09b40dcf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012268 Aug 17 11:15:18.700420 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 11:15:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:19.699597 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8900b294-298d-4e98-81f1-531aedb20e86 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:19.701101 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8900b294-298d-4e98-81f1-531aedb20e86 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Aug 17 11:15:19.701791 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 24/48] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:20.257832 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-aac3f521-0edd-4ec9-b63b-cf284307a121 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:20.263930 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-aac3f521-0edd-4ec9-b63b-cf284307a121 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-aac3f521-0edd-4ec9-b63b-cf284307a121 admin admin] Request method failure captured: Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Host: 10.222.0.15 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_M3H2qwt41lJoFup5ughz0Ees6As8o2xlGpwcIISDg0EK5UbFZ2JAmrAb8uLD66Kwo6M_ZzyK2dizco4PkY83u_FceidgZ5r9az38MBXWZJ3rA3g7SSdtibVcK_Gi3UIHADfQ2tFKPmQG6EbeGiqPw3Onl5YaB8q6eELyQPqI5WlyY0 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 17 11:15:20.265457 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User: admin Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: method: > Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: exception: Flavor 451 could not be found. Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: action_args: {'id': '451'} Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:20.267114 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:20.268026 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.269128 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-aac3f521-0edd-4ec9-b63b-cf284307a121 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:20.270215 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-aac3f521-0edd-4ec9-b63b-cf284307a121 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.424642 Aug 17 11:15:20.270215 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:15:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:20.276813 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-4d6a795c-0118-4d0d-a323-9fde4ebf7bab admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:20.291660 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-4d6a795c-0118-4d0d-a323-9fde4ebf7bab admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018552 Aug 17 11:15:20.292190 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 25/50] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:15:20.301589 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:20.316693 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018633 Aug 17 11:15:20.317191 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 11:15:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:15:20.326782 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-131e92d9-1d11-4941-8945-f9e1adbe235e admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:20.332309 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-131e92d9-1d11-4941-8945-f9e1adbe235e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-131e92d9-1d11-4941-8945-f9e1adbe235e admin admin] Request method failure captured: Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept: application/json Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Connection: keep-alive Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Content-Length: 0 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.90 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABi_M3H2qwt41lJoFup5ughz0Ees6As8o2xlGpwcIISDg0EK5UbFZ2JAmrAb8uLD66Kwo6M_ZzyK2dizco4PkY83u_FceidgZ5r9az38MBXWZJ3rA3g7SSdtibVcK_Gi3UIHADfQ2tFKPmQG6EbeGiqPw3Onl5YaB8q6eELyQPqI5WlyY0 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Aug 17 11:15:20.333841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a51c402175ae474ead919cb127abbed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a51c402175ae474ead919cb127abbed4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a51c402175ae474ead919cb127abbed4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant: admin Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Id: a51c402175ae474ead919cb127abbed4 Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User: admin Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Id: ab9a1f4b532d435bba8da86daefc5152 Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: X-User-Name: admin Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: method: > Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: exception: Flavor 451 could not be found. Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: action_args: {'id': '451'} Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:15:20.335227 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:20.336048 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Aug 17 11:15:20.337080 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-131e92d9-1d11-4941-8945-f9e1adbe235e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:15:20.338128 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-131e92d9-1d11-4941-8945-f9e1adbe235e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011912 Aug 17 11:15:20.338128 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 26/52] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:15:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:21.309264 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:21.310289 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 17 11:15:21.310684 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:21.854258 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-317d4950-5772-4522-bf64-a356ef6ffb73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:15:21.874753 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-317d4950-5772-4522-bf64-a356ef6ffb73 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.423693 Aug 17 11:15:21.875289 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 27/54] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 11:15:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:15:22.839733 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:22.840725 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 17 11:15:22.841091 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:23.396025 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-00efdc35-f175-4bf7-a118-32f410560a6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:15:23.417454 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-00efdc35-f175-4bf7-a118-32f410560a6f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.440297 Aug 17 11:15:23.418037 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 28/56] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 11:15:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:15:24.399872 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:24.400907 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 17 11:15:24.401299 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:24.965615 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-41c23906-33c0-4609-a4d9-1690bbeb6da7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:15:24.986751 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-41c23906-33c0-4609-a4d9-1690bbeb6da7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448898 Aug 17 11:15:24.987300 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 29/58] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 11:15:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:15:25.953847 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:25.954845 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 17 11:15:25.955235 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 30/59] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:26.521530 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-50f3f18e-a9f4-40c5-9bff-2b76465a0ad2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:15:26.542877 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-50f3f18e-a9f4-40c5-9bff-2b76465a0ad2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.448841 Aug 17 11:15:26.543425 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 30/60] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 11:15:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:15:27.513012 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:27.514044 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 17 11:15:27.514441 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 31/61] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:15:28.074640 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-744e5a0b-ed8f-4617-844f-b0eb408b7950 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:15:28.095073 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-744e5a0b-ed8f-4617-844f-b0eb408b7950 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.445656 Aug 17 11:15:28.095604 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1202 bytes} [Wed Aug 17 11:15:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:16:21.344355 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.345862 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6893cb11-89fd-4d59-bcd1-fe2c12954606 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002231 Aug 17 11:16:21.346488 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:16:21.359811 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:21.762255 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-422b39e0-da0e-41b0-9979-86861d32346f admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.782428 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-422b39e0-da0e-41b0-9979-86861d32346f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.427098 Aug 17 11:16:21.782952 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 32/64] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:16:21.803866 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:21.808100 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-8f819c5c-b3a6-4d6c-9e28-31552b8ec6d3 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.816777 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-8f819c5c-b3a6-4d6c-9e28-31552b8ec6d3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014346 Aug 17 11:16:21.817298 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 33/65] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:16:21.829281 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-d8a2add6-bb28-480a-956f-fe54de7ea8e3 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.837440 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-d8a2add6-bb28-480a-956f-fe54de7ea8e3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 Aug 17 11:16:21.837950 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 33/66] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:16:21.849922 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.858453 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012781 Aug 17 11:16:21.858975 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 34/67] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:16:21.870819 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-8dfe766e-3b92-4d47-a50b-cfd95355a17e admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:16:21.878484 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-8dfe766e-3b92-4d47-a50b-cfd95355a17e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011365 Aug 17 11:16:21.878990 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 34/68] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 11:16:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:19:21.127519 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:21.128544 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 17 11:19:21.128925 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:19:21.270867 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=6 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:21.444679 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:21.447475 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:19:21.447475 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:19:21.448601 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:21.449107 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:21.449554 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:21.450302 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:21.450919 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:21.451343 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:21.495260 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-c8dc820f-beb5-4787-8419-acbfcb358aab admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.227030 Aug 17 11:19:21.495841 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 35/70] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:19:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:19:22.335491 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:22.336493 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 17 11:19:22.336888 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:19:22.541940 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:22.544236 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:19:22.544236 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:19:22.545332 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:22.545852 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:22.546273 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:22.547001 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:22.547428 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:22.547849 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:22.567057 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-71f565b3-10aa-4179-aabe-232a989dbffb admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090388 Aug 17 11:19:22.567593 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 36/72] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:19:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:19:33.812519 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:33.813821 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Aug 17 11:19:33.814361 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:19:33.955165 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:33.955897 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell1:SELECT=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:33.956541 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=8 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:34.008666 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:34.011103 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:19:34.011103 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:19:34.012240 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:34.012722 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:34.013148 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:34.013936 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:34.014383 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:34.014799 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:34.039525 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-65d1e24c-2626-49cc-99bf-ce03d5ebe3bb admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088755 Aug 17 11:19:34.039997 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 37/74] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:19:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:19:34.866073 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:34.867123 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-076ba7cd-f7c5-4eff-ac5b-a31eeda31ba1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 17 11:19:34.867519 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 11:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:19:35.068458 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:19:35.070850 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:19:35.070850 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: warnings.warn(msg) Aug 17 11:19:35.072281 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:35.072740 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:35.073179 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:35.073899 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:19:35.074337 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:19:35.074745 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:19:35.095935 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-bed59ecd-0389-4e0f-a176-7b079c2988bc admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089278 Aug 17 11:19:35.096494 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 38/76] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 11:19:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:20:31.938370 dv-cinder-853450-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 11:20:31.939246 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: Wed Aug 17 11:20:31 2022 - graceful shutdown triggered... Aug 17 11:20:31.939724 dv-cinder-853450-1-iscsi devstack@n-api.service[105462]: Gracefully killing worker 2 (pid: 105462)... Aug 17 11:20:31.940096 dv-cinder-853450-1-iscsi devstack@n-api.service[105461]: Gracefully killing worker 1 (pid: 105461)... Aug 17 11:20:32.939619 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: worker 1 buried after 1 seconds Aug 17 11:20:32.939619 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: worker 2 buried after 1 seconds Aug 17 11:20:32.939619 dv-cinder-853450-1-iscsi devstack@n-api.service[105460]: goodbye to uWSGI. Aug 17 11:20:32.942093 dv-cinder-853450-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 11:20:32.943030 dv-cinder-853450-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 11:20:32.947886 dv-cinder-853450-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 11:20:32.963353 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 11:20:32 2022] *** Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: nodename: dv-cinder-853450-1-iscsi Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: machine: x86_64 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: clock source: unix Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: pcre jit disabled Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: detected number of CPU cores: 4 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: current working directory: / Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: detected binary path: /usr/bin/uwsgi-core Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: your processes number limit is 47680 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: your memory page size is 4096 bytes Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: detected max file descriptor number: 2048 Aug 17 11:20:32.965372 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: lock engine: pthread robust mutexes Aug 17 11:20:32.966442 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: thunder lock: enabled Aug 17 11:20:32.966442 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 11:20:32.966442 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 11:20:33.006316 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: Python main interpreter initialized at 0x558518c349c0 Aug 17 11:20:33.006316 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: python threads support enabled Aug 17 11:20:33.006316 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: your server socket listen backlog is limited to 100 connections Aug 17 11:20:33.006316 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: your mercy for graceful operations on workers is 90 seconds Aug 17 11:20:33.006835 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 11:20:33.006835 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: *** Operational MODE: preforking *** Aug 17 11:20:33.007187 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: *** uWSGI is running in multiple interpreter mode *** Aug 17 11:20:33.007187 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: spawned uWSGI master process (pid: 120566) Aug 17 11:20:33.009910 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: spawned uWSGI worker 1 (pid: 120583, cores: 1) Aug 17 11:20:33.009910 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: spawned uWSGI worker 2 (pid: 120584, cores: 1) Aug 17 11:20:33.009910 dv-cinder-853450-1-iscsi devstack@n-api.service[120566]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 11:20:33.007375 dv-cinder-853450-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 11:20:33.657085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 11:20:33.657736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 11:20:34.776398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:20:34.776398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: from cryptography.utils import int_from_bytes Aug 17 11:20:34.777171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:20:34.777171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: from cryptography.utils import int_from_bytes Aug 17 11:20:34.786637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:20:34.786637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: from cryptography.utils import int_from_bytes Aug 17 11:20:34.787184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:20:34.787184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: from cryptography.utils import int_from_bytes Aug 17 11:20:37.069460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:20:37.070801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:20:37.070801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:20:37.070801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:20:37.070801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:20:37.071315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.072435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.072435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.072624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.072851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.073164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.073515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.073869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.074196 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.074420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.074765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.075081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853450-1-iscsi {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.075404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.075712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.075990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.076312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.076658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.076960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.077263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.077880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.078350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.078611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.078954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.079352 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.079564 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.079899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.080233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.080505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.080847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.081124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.081660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853450-1-iscsi {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.082398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.082398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.082593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.082952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.083817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.083817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.083817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.084115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.084357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.084694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.085060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.085380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.086083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.086083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.086248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.087645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.087645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.087645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.087645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.087645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.089996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.090270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:20:37.090270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:20:37.091055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.091055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.091331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:20:37.091486 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.091634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:20:37.091788 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.091935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:20:37.092070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092649 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092797 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.092937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.093978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094423 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.094992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.095138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.095274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.095634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853450-1-iscsi {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.095787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.095931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096235 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.096957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.097882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.098895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099180 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099617 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.099904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100182 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.100886 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853450-1-iscsi {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101617 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.101911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.102903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103328 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.103899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104324 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.104931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.105879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106470 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.106884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.107810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.108916 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.109935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.110990 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.111142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.111142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.111431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.111575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.111733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.112058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.112261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.112427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.113239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.113411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.113582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.113726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.113888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.114978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.115133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.115276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.115418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.115570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.115788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.115941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.116115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.116355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.116529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.117554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.117674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.117674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118188 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118652 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.118816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.118902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.119133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.119233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.119314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.119422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.119508 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.119590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.119681 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.119773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.119889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.119989 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.120203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.120458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.120627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120716 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.120808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.120892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.120991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.121084 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.121169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.121252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.121335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.121441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.121537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.121610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.121702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.121786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.121868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.122034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.122209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.122363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.122521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.122668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.122811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.123030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.123240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.124277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.124500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.124709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.124929 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.125141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.125338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.125678 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.125897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.126106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.126332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.126621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.126842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.127102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.127377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.127628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.127875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.128125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.128326 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.128482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.128637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.128637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.128926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.129077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.129227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.129379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.129648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.129884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.130069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.130383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.130609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.130758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.130909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.131067 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.131226 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.131377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.131377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.131377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.131377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.131377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.132199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.132354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.132497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.132639 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.132796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.132941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.133082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.133224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.133373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.133650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.133811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.133962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.134113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.134268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.134409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.134551 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:20:37.134751 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.134912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.135953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.136952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.137879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138647 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.138941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139520 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.139969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.140131 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.140274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.140417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.140558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.140877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.141050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.141198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.141387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.141570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.141950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142117 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142561 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142703 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.142846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.143898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144647 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.144942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.145094 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.145285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.145463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.146177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.146347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.146494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.146637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.146799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.147956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148100 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148402 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.148998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.149953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.150725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.151410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.151553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.151705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.151855 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152537 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.152849 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.153762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154656 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.154950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155330 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155623 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.155927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.156973 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.157221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.157376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.157621 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.157815 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.157971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158416 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.158857 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.159912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.160933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161370 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161551 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161696 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.161996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.162359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.162561 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.162721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.162865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163324 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.163908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.164963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165734 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.165909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166549 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.166845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.167993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.168896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169048 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169530 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.169985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170695 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.170998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.171147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.171338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.171557 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.171724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.171891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.172940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173094 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.173726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174642 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.174799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175578 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.175884 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176196 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176548 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.176859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.177908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.178840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.179941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.180377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.180527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.180676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.180824 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.180983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181810 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.181970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.182121 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.182280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.182437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.182700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.182854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183013 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.183789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184694 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.184850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185009 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.185987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186137 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.186993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.187870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.188961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.189946 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190571 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190571 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.190864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.191942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.192975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.193134 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.193353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.193563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.193716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.193874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.194942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.195886 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.196037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.196234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.196712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.196873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.197893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.198931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.199874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.200939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.201232 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.201383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.201383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.201383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.201878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.202994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.203226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.203382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.203531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.203680 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.203680 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.204840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.205974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.206925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.207902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208652 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.208963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209286 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.209988 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210137 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210521 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.210999 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.211910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.212213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.212365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.212365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.212666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.212855 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213172 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213766 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.213933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.214889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.215979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.216974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.217990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.218140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.218314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.218538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.218693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.218864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.219803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.220887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.221984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222134 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222134 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222428 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222428 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.222713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223555 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.223871 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.224989 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.225971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.226919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227396 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.227874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.228170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.228329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.228558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.228786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.228954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.229264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.229461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.229620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.229781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.229940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230416 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.230882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231033 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231817 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.231984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.232897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.233987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234456 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.234928 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235560 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.235997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236303 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.236911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237386 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.237909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.238915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.239851 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.240847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.241960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242427 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.242908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.243195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.243343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.243493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.243652 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.243830 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244423 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.244900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245208 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.245907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.246978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247127 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247443 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.247931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.248838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249662 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.249981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.250750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.251840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.252928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.253226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.253376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.253376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.253695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.253869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254426 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.254885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255044 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255243 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255425 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.255911 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256232 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.256854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257162 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257321 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.257868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.258971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.259939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.260277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.260277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.260635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.260787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.260943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261242 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.261892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.262904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.263956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.264857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.265314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.265534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.265692 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.265859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266169 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.266939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.267106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.267265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.267424 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.267581 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.270984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.271949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.272908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.273058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.273219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.273379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.273648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.273847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.274108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.274315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.274498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.274757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.274922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275764 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.275915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276215 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.276877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277695 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.277848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278006 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.278933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.279240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.279398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.279558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.279709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.279868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.280616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281013 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.281932 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.282896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.283846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.284458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.284550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.284653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.284653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.284847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.285032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.285215 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.285367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.285731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.285829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.286040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.286352 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.286445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.286658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.286968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.287078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.287281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.287585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.287686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.287889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.288184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.288284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.288563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.288794 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.288901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.289207 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.289389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.289549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.289790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.290019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.290124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.290397 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.290617 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.290711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.291058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.291283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.291387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.291667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.291877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.292009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.292329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.292469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.292642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.292954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.293047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.293271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.294997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295568 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.295681 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.296073 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.296182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.296402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.296689 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.296804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.297036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.297288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.297399 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.297701 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.297903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.298024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.298390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.298542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.298713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299341 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.299997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.300182 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.300321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.300630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.300791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.300940 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.301244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.301394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.301584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.301914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.302017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.302229 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.302533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.302633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.302834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.303140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.303245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.303440 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.303735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.303860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.304033 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.304336 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.304430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.304743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.304916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.305018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.305224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.305584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.305783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.305890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.306136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.306228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.306444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.306728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.306831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.307065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.307318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.307421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.307654 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.307914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.308020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.308283 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.308514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.308610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.308943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.309105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.309258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.309621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.309735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.309933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.310219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.310317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.310556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.310805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.310915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.311164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.311394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.311488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.311772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.311982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.312111 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.312420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.312571 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.312730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.313040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.313139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.313349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.313816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.313925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.314014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.314284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.314388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.314612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.314888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.315004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.315231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.315476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.315572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.315857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.316055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.316157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.316466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.316666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.316792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.317103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.317414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.317578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.317755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.318066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.318160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.318434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.318678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.318779 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.319985 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.320285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.320474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.320609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.320920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.321042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.321249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.321954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.322064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.322353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.322593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.322692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.322995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.323202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.323324 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.323639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.323925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.324032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.324287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.324397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.324499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:20:37.324967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.325308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.325733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.326158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.326604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.327033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.327713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.328173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.328616 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.329065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.329523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.329956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.330374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.330838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.331258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.331680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.332549 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.332549 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.333002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.333512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.333872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.334570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.334693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.335240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.335587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.336088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.336411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.336843 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.337260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.337721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.338213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.338628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.339045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.339459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.340007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.340293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.340713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.341161 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.341597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.342011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.342432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.342846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.343304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.343698 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.344225 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.344709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.345006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.345455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.345889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.346333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.346806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.347230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.347943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.348397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.348825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.349246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.349684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.350004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.350322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.350638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.350973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.351294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.351613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.351929 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.352247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.352562 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.352878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.353195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.353570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.353888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.354203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.354525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.354841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.355156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.355470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.355802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.356155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.356479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.356803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.357124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.357466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.357784 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.358099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.358411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.358739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.359037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.359372 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.359690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.360000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.360442 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.360762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.361082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.361410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.361748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.362075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.362404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.362717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.363042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.363356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.363688 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.364033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.364371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.364701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.365011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.365318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.365654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.365969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.366295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.366608 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.366915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.367220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.367532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.367839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.368148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.368455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.368760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.369133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.369470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.369771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.370078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.370382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.370687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.370991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.371300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.371602 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.371904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.372207 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.372507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.372810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.373151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.373510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.373831 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.374160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.374473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.374799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.375106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.375427 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.375830 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.376062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.376373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.376757 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.377018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.377333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.378329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.378329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.378329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.379152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.379152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.379465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.379568 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.379816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.380137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.380461 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.380778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.381092 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.381455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.382550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.382550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.382550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.382771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.382942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.383260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.383573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.383887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.384204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.384521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.384891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.385217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.385556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.385883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.386208 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.386564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.386878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.387225 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.387552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.387869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.388182 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.388489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:20:37.388731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:20:37.480011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO dbcounter [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Registered counter for database nova_api Aug 17 11:20:37.500793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_db.sqlalchemy.engines [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.507870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writer thread running {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.542909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO dbcounter [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Registered counter for database nova_api Aug 17 11:20:37.563113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_db.sqlalchemy.engines [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.564075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.context [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3887d9d-dee7-43d6-9d53-02c47e9236a8(cell1) {{(pid=120583) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 11:20:37.568111 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:20:37.568584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:20:37.570176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:20:37.570293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writer thread running {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.570905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:20:37.571709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:20:37.573769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:20:37.575794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO dbcounter [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Registered counter for database nova_cell0 Aug 17 11:20:37.579841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO dbcounter [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Registered counter for database nova_cell1 Aug 17 11:20:37.587213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_db.sqlalchemy.engines [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.589015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_db.sqlalchemy.engines [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.595238 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writer thread running {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.596517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writer thread running {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.626687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.context [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a3887d9d-dee7-43d6-9d53-02c47e9236a8(cell1) {{(pid=120584) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 11:20:37.630740 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:20:37.631217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:20:37.632798 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:20:37.633543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:20:37.634023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:20:37.636063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:20:37.638106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO dbcounter [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Registered counter for database nova_cell0 Aug 17 11:20:37.642210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO dbcounter [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Registered counter for database nova_cell1 Aug 17 11:20:37.649294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_db.sqlalchemy.engines [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.651078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_db.sqlalchemy.engines [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.656631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writer thread running {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.659193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writer thread running {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.737904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO dbcounter [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Registered counter for database nova_cell0 Aug 17 11:20:37.744858 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_db.sqlalchemy.engines [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.750426 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writer thread running {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:37.801373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO dbcounter [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Registered counter for database nova_cell0 Aug 17 11:20:37.810062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_db.sqlalchemy.engines [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:20:37.814834 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writer thread running {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:20:38.066258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: WARNING keystonemiddleware.auth_token [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:20:38.074180 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: WARNING keystonemiddleware.auth_token [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:20:38.133249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: WARNING keystonemiddleware.auth_token [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:20:38.140747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: WARNING keystonemiddleware.auth_token [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:20:38.421054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: WARNING keystonemiddleware.auth_token [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:20:38.427519 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: WARNING keystonemiddleware.auth_token [None req-82e32252-c821-4858-b1fa-eb96f5ab20d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:20:38.434248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558518c349c0 pid: 120583 (default app) Aug 17 11:20:38.513773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: WARNING keystonemiddleware.auth_token [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 11:20:38.521827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: WARNING keystonemiddleware.auth_token [None req-2e224c79-88eb-4528-9627-9ca601a89db7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 11:20:38.531708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558518c349c0 pid: 120584 (default app) Aug 17 11:21:13.123067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.129073 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.130398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.133802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.238410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.239476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.240962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:13.241702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:14.696666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-da49f4bc-b52d-4b7b-9a13-6389ddcebd27 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Action: 'create', calling method: .version_select at 0x7f9045914310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1729122124"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:14.836608 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1745de9e-116f-411e-be40-62dd4b33adac tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Action: 'create', calling method: .version_select at 0x7f9045911280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1114917155", "metadata": {"Type": "work"}}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:17.202919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-da49f4bc-b52d-4b7b-9a13-6389ddcebd27 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.977648 Aug 17 11:21:17.203673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Aug 17 11:21:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3981 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 11:21:17.218845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9750b81c-2abf-47ea-a956-3304641d76a5 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90457751f0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:17.347128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1745de9e-116f-411e-be40-62dd4b33adac tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.244590 Aug 17 11:21:17.348050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 11:21:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4248 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 11:21:17.363422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d661d7fa-551b-41bc-b688-0d4090718c75 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045773160>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:17.407774 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9750b81c-2abf-47ea-a956-3304641d76a5 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 200 len: 345 microversion: 2.1 time: 0.193855 Aug 17 11:21:17.408479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:17 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:17.533810 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d661d7fa-551b-41bc-b688-0d4090718c75 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 200 len: 353 microversion: 2.1 time: 0.174497 Aug 17 11:21:17.534969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:17 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:18.423088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-717615a8-f2ec-4343-bcf9-8178f5c6328f tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90457758b0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:18.550857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5be1fa7a-5563-4dc9-87da-23ba5e6e7ad1 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045773820>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:18.611080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-717615a8-f2ec-4343-bcf9-8178f5c6328f tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 200 len: 345 microversion: 2.1 time: 0.191716 Aug 17 11:21:18.611912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:18 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:18.697573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5be1fa7a-5563-4dc9-87da-23ba5e6e7ad1 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 200 len: 353 microversion: 2.1 time: 0.153021 Aug 17 11:21:18.698276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:18 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:19.625465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c7ec28bb-2049-4ea1-86e1-c1f0cda409ae tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9045775f70>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:19.713957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-698dfd4c-357f-4493-85a9-46be4c977c38 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045773ee0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:19.851315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-698dfd4c-357f-4493-85a9-46be4c977c38 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 200 len: 354 microversion: 2.1 time: 0.143200 Aug 17 11:21:19.852283 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:19 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:19.865794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7515f55f-f23b-4853-8b3c-b9b73e9e44b9 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045773af0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.011621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7515f55f-f23b-4853-8b3c-b9b73e9e44b9 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 200 len: 354 microversion: 2.1 time: 0.150414 Aug 17 11:21:20.013915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:19 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:20.028572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7bebc42d-6ca1-434d-8efc-88026e1962dd tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045773430>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.057287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c7ec28bb-2049-4ea1-86e1-c1f0cda409ae tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 200 len: 346 microversion: 2.1 time: 0.435811 Aug 17 11:21:20.067383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 4/9] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:19 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 346 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:20.075200 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6634591f-10dc-4706-a895-da7601106fbe tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Action: 'create', calling method: .version_select at 0x7f9045775ca0>, body: {"snapshot": {"volume_id": "c64d93bf-ae78-4a05-aec1-996aedd0113a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-678986103"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:20.203272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7bebc42d-6ca1-434d-8efc-88026e1962dd tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 202 len: 0 microversion: 2.1 time: 0.180006 Aug 17 11:21:20.204415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:21:20 2022] DELETE /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:21:20.214396 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0110338a-efa6-4c73-98c2-10a4ada28b1b tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045770040>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.292362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0110338a-efa6-4c73-98c2-10a4ada28b1b tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 200 len: 353 microversion: 2.1 time: 0.082569 Aug 17 11:21:20.293143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 7/11] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:20 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:20.519192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6634591f-10dc-4706-a895-da7601106fbe tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.450403 Aug 17 11:21:20.520299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 5/12] 10.222.0.15 () {60 vars in 1162 bytes} [Wed Aug 17 11:21:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:20.531641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0a804032-d7c3-4f02-8c8d-dfa98d7dc740 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90457730d0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.699438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0a804032-d7c3-4f02-8c8d-dfa98d7dc740 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.172117 Aug 17 11:21:20.705912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:20 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:20.713204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1bbe0c15-2ab1-476c-911c-475168701638 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90457803a0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.828332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1bbe0c15-2ab1-476c-911c-475168701638 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.120998 Aug 17 11:21:20.835484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 6/14] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 11:21:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:20.842238 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-821140ae-545f-464a-8940-3f8991e4767c tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9045773820>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:20.910663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-821140ae-545f-464a-8940-3f8991e4767c tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.074056 Aug 17 11:21:20.911221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 9/15] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:20 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:21.305826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-324c45b1-2632-440d-aea1-7a5bf6e18a98 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Calling method '.version_select at 0x7f9045780dc0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:21.374556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-324c45b1-2632-440d-aea1-7a5bf6e18a98 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] HTTP exception thrown: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-324c45b1-2632-440d-aea1-7a5bf6e18a98 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Request method failure captured: Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 HTTP/1.1 Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M8pp2rhwR3Nt2uixRti6ddxRywpKEzXk7L6bctmjstkxodubRJuZoQMtt-RpI-ygjczxuuFii0wiKI0L7hMAblTk_S8KBzFnuc3SSGmq7f_Ab1KHpnjxHI0Vlgz1RNlJo0KE7F_UOZyV2aAXdB9h_8eKHJeAzh4vSdwoZoWnkTK9vA Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 654e59b0c4cb426997237322c7ae542c Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-VolumesGetTestJSON-913551057 Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:21:21.379679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/654e59b0c4cb426997237322c7ae542c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/654e59b0c4cb426997237322c7ae542c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/654e59b0c4cb426997237322c7ae542c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_654e59b0c4cb426997237322c7ae542c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-VolumesGetTestJSON-913551057 Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 654e59b0c4cb426997237322c7ae542c Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-VolumesGetTestJSON-913551057 Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-VolumesGetTestJSON-913551057-project Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 62d8a1bdb725482d9e88d0e6703794b7 Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-VolumesGetTestJSON-913551057-project Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'a77572cc-f5e6-48ba-8b63-ec492d095cb6'} Aug 17 11:21:21.380795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. (HTTP 404) (Request-ID: req-b8a9af6a-6c57-4af0-9730-301bc406c7d7) Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:21.381585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:21.382566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 11:21:21.383558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-324c45b1-2632-440d-aea1-7a5bf6e18a98 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] Returning 404 to user: Volume a77572cc-f5e6-48ba-8b63-ec492d095cb6 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-324c45b1-2632-440d-aea1-7a5bf6e18a98 tempest-VolumesGetTestJSON-913551057 tempest-VolumesGetTestJSON-913551057-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6" status: 404 len: 109 microversion: 2.1 time: 0.079573 Aug 17 11:21:21.384541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 7/16] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:21 2022] GET /compute/v2.1/os-volumes/a77572cc-f5e6-48ba-8b63-ec492d095cb6 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:21:21.929341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f614b2b6-22d3-4ea3-bd7e-230a70269ab7 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f904614f820>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:21.996964 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f614b2b6-22d3-4ea3-bd7e-230a70269ab7 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.074321 Aug 17 11:21:21.997786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:21 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:22.911286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1868311955", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:23.017275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-50d0a773-aa52-4aa9-8eda-9d4d5bd222fb tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9045780e50>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:23.067938 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-50d0a773-aa52-4aa9-8eda-9d4d5bd222fb tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.062656 Aug 17 11:21:23.074151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 9/18] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:23 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:23.244415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] validate_networks() for [('5e0c78bc-2ba7-4ce5-80e0-43b85d3aa9c8', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:21:24.084785 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-698fce04-d80a-4d53-8dab-34d0e44b904e tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90456e13a0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:24.149705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-698fce04-d80a-4d53-8dab-34d0e44b904e tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.072389 Aug 17 11:21:24.150759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 10/19] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:24 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:25.163055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-137cc0c5-5758-4b28-97f7-49f1796fa3a2 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90456e19d0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:25.210052 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-137cc0c5-5758-4b28-97f7-49f1796fa3a2 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.051173 Aug 17 11:21:25.216496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 11/20] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:25 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:25.808670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:21:25.809138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:21:25.809647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:21:25.810364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:21:25.810963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:21:25.858156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:25.864212 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:25.864849 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:25.873384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:25.874095 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:25.874567 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:25.965719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:21:25.987582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for user b5b61f023e1a403da575d83027e777ee and project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:21:26.014117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:21:26.017889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:21:26.223112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6c091409-c258-4a36-9c75-bc9d5a69f253 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90456ea0d0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:26.232237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cfe7bab8-8db4-4495-b9a1-8f02ee34b060 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.380192 Aug 17 11:21:26.242202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 10/21] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:21:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 4386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:21:26.248313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4e8b27fb-9b9d-4485-8c37-ac229fb8af6b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:26.248946 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4e8b27fb-9b9d-4485-8c37-ac229fb8af6b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:26.302975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6c091409-c258-4a36-9c75-bc9d5a69f253 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.084153 Aug 17 11:21:26.303552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:26 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:26.697597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4e8b27fb-9b9d-4485-8c37-ac229fb8af6b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:26.724237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4e8b27fb-9b9d-4485-8c37-ac229fb8af6b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1222 microversion: 2.1 time: 0.480061 Aug 17 11:21:26.724829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:26 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1222 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:27.317891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9de95d82-0b9e-4f69-a894-15aa71e0b7f6 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9045780ee0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:27.376605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9de95d82-0b9e-4f69-a894-15aa71e0b7f6 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 287 microversion: 2.1 time: 0.063923 Aug 17 11:21:27.377872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 13/24] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:27 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:27.387758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-638454064", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:27.389780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dd2de152-58a0-4b16-8fb1-945e27ac9256 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9045775e50>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:27.494335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-dd2de152-58a0-4b16-8fb1-945e27ac9256 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 202 len: 0 microversion: 2.1 time: 0.109822 Aug 17 11:21:27.495811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 17 11:21:27 2022] DELETE /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:21:27.507219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-74b3418f-a06a-4e18-b49e-ee03a1de4ead tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90456ea1f0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:27.527299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] validate_networks() for [('5e0c78bc-2ba7-4ce5-80e0-43b85d3aa9c8', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:21:27.553322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-74b3418f-a06a-4e18-b49e-ee03a1de4ead tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 200 len: 286 microversion: 2.1 time: 0.052385 Aug 17 11:21:27.554995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 15/26] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:27 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:28.223345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ab076ce2-bea0-4b66-b349-ece37fdd372f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: .version_select at 0x7f90456ea820>, body: {"keypair": {"name": "tempest-keypair-1086997901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGT/PBAa70J4+sget0HMCYwc2Iz1vFLptpRtaS/L6+JRTDSZlz4yGST6bDDy35mKE/DKF1yNNxTT5XkBsincaiXIINVgrrRVytPBm21/rhxLKhKxAnZNnjzbqxC6f2QYw=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:28.348671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-ab076ce2-bea0-4b66-b349-ece37fdd372f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for project e247a3ec0a244abf9d11299cc53b9311. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:21:28.366409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-ab076ce2-bea0-4b66-b349-ece37fdd372f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for user 1e6765845c4c4960bfee00c6384e8a4b and project e247a3ec0a244abf9d11299cc53b9311. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:21:28.375025 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:21:28.375615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:21:28.376363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:21:28.376902 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:21:28.377620 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:21:28.397494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:28.398658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:28.399268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:28.400173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:28.400809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:28.402453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:28.452110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:21:28.464155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for user b5b61f023e1a403da575d83027e777ee and project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:21:28.487507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ab076ce2-bea0-4b66-b349-ece37fdd372f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.616683 Aug 17 11:21:28.490419 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 16/27] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 11:21:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 621 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 11:21:28.499709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:21:28.507057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:21:28.611375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2e47a7ce-9358-414a-8b9b-580d5b67337f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.233347 Aug 17 11:21:28.621579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 12/28] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:21:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 11:21:28.636006 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c8e9aa9f-ab3e-46e2-8fc5-7156cf505b32 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f904463b9d0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:28.696667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-c8e9aa9f-ab3e-46e2-8fc5-7156cf505b32 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] HTTP exception thrown: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c8e9aa9f-ab3e-46e2-8fc5-7156cf505b32 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Request method failure captured: Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb HTTP/1.1 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8p852zJfRERGN5Ei1hSz5LeSCKOoKlrEbbf0Fm2DPFGUizyyyuDgRqgtIhrNig2asOrA0l3VcK3BqQx7X8wFqgY_KFqRdebY25NPGt-qJ-PjCvtpwKDty9hyX5-GC0bG5z8CiX0A3nU54UT6lbRFs30Hb-gh-knww1vm5xAFv35mU Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:21:28.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_710e093196934d4a9e2d51aad5e5d6e3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e7e09110c7834ef9b96240a28711dcf5 Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb'} Aug 17 11:21:28.703795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. (HTTP 404) (Request-ID: req-9ae671ba-2d2f-4211-bf88-ad7d3b3cceea) Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.704583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:28.705645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 11:21:28.707022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. Aug 17 11:21:28.708536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:28.710650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c8e9aa9f-ab3e-46e2-8fc5-7156cf505b32 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Returning 404 to user: Snapshot 6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:21:28.711719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c8e9aa9f-ab3e-46e2-8fc5-7156cf505b32 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb" status: 404 len: 111 microversion: 2.1 time: 0.088553 Aug 17 11:21:28.714230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 13/29] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 11:21:28 2022] GET /compute/v2.1/os-snapshots/6d19cd34-fdea-42d6-a5e6-41dedeb5b8bb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:21:28.743483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-30fed87a-721b-4c91-a115-90c94a436512 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:28.744822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-30fed87a-721b-4c91-a115-90c94a436512 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:28.987574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-30fed87a-721b-4c91-a115-90c94a436512 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:29.016628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-30fed87a-721b-4c91-a115-90c94a436512 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1221 microversion: 2.1 time: 0.294817 Aug 17 11:21:29.019821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 14/30] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:28 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1221 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:29.037657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34081bc9-0c06-4fc8-b179-906ca58d3dee tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9044639ca0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:29.213533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-34081bc9-0c06-4fc8-b179-906ca58d3dee tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 202 len: 0 microversion: 2.1 time: 0.191251 Aug 17 11:21:29.220119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 15/31] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:21:29 2022] DELETE /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:21:29.225674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c861b1f4-5c7f-4fcd-9d01-f7f50b3457f7 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9044639940>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:29.422124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c861b1f4-5c7f-4fcd-9d01-f7f50b3457f7 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 200 len: 345 microversion: 2.1 time: 0.200679 Aug 17 11:21:29.423671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:29 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 345 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:29.580193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-718302143", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "networks": [{"uuid": "c99a7c7d-a900-430a-9acd-4f865168a5eb"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:29.814930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] validate_networks() for [('c99a7c7d-a900-430a-9acd-4f865168a5eb', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:21:30.039997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-375391a0-12e6-4821-9262-deaca7258fcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:30.040885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-375391a0-12e6-4821-9262-deaca7258fcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:30.340996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-375391a0-12e6-4821-9262-deaca7258fcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:30.348944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-375391a0-12e6-4821-9262-deaca7258fcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1221 microversion: 2.1 time: 0.313663 Aug 17 11:21:30.353270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:30 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1221 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:30.437593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dffe7fd4-5ff4-4f88-ad98-1a2362f401f3 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f9044639ee0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:31.202850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-dffe7fd4-5ff4-4f88-ad98-1a2362f401f3 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] HTTP exception thrown: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dffe7fd4-5ff4-4f88-ad98-1a2362f401f3 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Request method failure captured: Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a HTTP/1.1 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8p852zJfRERGN5Ei1hSz5LeSCKOoKlrEbbf0Fm2DPFGUizyyyuDgRqgtIhrNig2asOrA0l3VcK3BqQx7X8wFqgY_KFqRdebY25NPGt-qJ-PjCvtpwKDty9hyX5-GC0bG5z8CiX0A3nU54UT6lbRFs30Hb-gh-knww1vm5xAFv35mU Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:21:31.207250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_710e093196934d4a9e2d51aad5e5d6e3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e7e09110c7834ef9b96240a28711dcf5 Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'c64d93bf-ae78-4a05-aec1-996aedd0113a'} Aug 17 11:21:31.208799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. (HTTP 404) (Request-ID: req-d8bbfddf-961c-4caf-969c-b45050eb36e2) Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.209669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:31.210817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 11:21:31.212159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.213326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.216254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dffe7fd4-5ff4-4f88-ad98-1a2362f401f3 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Returning 404 to user: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:21:31.217308 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-dffe7fd4-5ff4-4f88-ad98-1a2362f401f3 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 404 len: 109 microversion: 2.1 time: 0.784283 Aug 17 11:21:31.218472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 18/34] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:30 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 109 bytes in 786 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:21:31.232897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae8d69e1-70c8-423b-a343-917a7542d5f9 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f90445a2280>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:31.397694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-ae8d69e1-70c8-423b-a343-917a7542d5f9 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] HTTP exception thrown: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae8d69e1-70c8-423b-a343-917a7542d5f9 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Request method failure captured: Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a HTTP/1.1 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8p852zJfRERGN5Ei1hSz5LeSCKOoKlrEbbf0Fm2DPFGUizyyyuDgRqgtIhrNig2asOrA0l3VcK3BqQx7X8wFqgY_KFqRdebY25NPGt-qJ-PjCvtpwKDty9hyX5-GC0bG5z8CiX0A3nU54UT6lbRFs30Hb-gh-knww1vm5xAFv35mU Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:21:31.399633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_710e093196934d4a9e2d51aad5e5d6e3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e7e09110c7834ef9b96240a28711dcf5 Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'c64d93bf-ae78-4a05-aec1-996aedd0113a'} Aug 17 11:21:31.401023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. (HTTP 404) (Request-ID: req-69faf4b7-1902-4956-bedc-661e576f6c9a) Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.404977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:21:31.406230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 11:21:31.408185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae8d69e1-70c8-423b-a343-917a7542d5f9 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Returning 404 to user: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ae8d69e1-70c8-423b-a343-917a7542d5f9 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 404 len: 109 microversion: 2.1 time: 0.172996 Aug 17 11:21:31.409493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 19/35] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:21:31 2022] DELETE /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:21:31.411065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:31.411065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:31.432543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:31.433039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:31.433498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:31.435758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:31.436236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:31.436664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:31.735890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:31.757150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e43707ac-e388-4c3b-a9a6-454acec75ae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1273 microversion: 2.1 time: 0.354100 Aug 17 11:21:31.757783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 20/36] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:31 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:31.770958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-819b5f60-90e7-4328-b98f-af3cf284d074 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Calling method '.version_select at 0x7f904452b550>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:32.223251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-819b5f60-90e7-4328-b98f-af3cf284d074 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] HTTP exception thrown: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-819b5f60-90e7-4328-b98f-af3cf284d074 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Request method failure captured: Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a HTTP/1.1 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8p852zJfRERGN5Ei1hSz5LeSCKOoKlrEbbf0Fm2DPFGUizyyyuDgRqgtIhrNig2asOrA0l3VcK3BqQx7X8wFqgY_KFqRdebY25NPGt-qJ-PjCvtpwKDty9hyX5-GC0bG5z8CiX0A3nU54UT6lbRFs30Hb-gh-knww1vm5xAFv35mU Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:21:32.225251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/710e093196934d4a9e2d51aad5e5d6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_710e093196934d4a9e2d51aad5e5d6e3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 710e093196934d4a9e2d51aad5e5d6e3 Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-329620645 Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e7e09110c7834ef9b96240a28711dcf5 Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesSnapshotsTestJSON-329620645-project Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'c64d93bf-ae78-4a05-aec1-996aedd0113a'} Aug 17 11:21:32.226664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. (HTTP 404) (Request-ID: req-f0ced972-8cd1-4e82-be56-db7c839d234c) Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:32.227825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:21:32.228745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 11:21:32.229711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-819b5f60-90e7-4328-b98f-af3cf284d074 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] Returning 404 to user: Volume c64d93bf-ae78-4a05-aec1-996aedd0113a could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:21:32.230625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-819b5f60-90e7-4328-b98f-af3cf284d074 tempest-VolumesSnapshotsTestJSON-329620645 tempest-VolumesSnapshotsTestJSON-329620645-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a" status: 404 len: 109 microversion: 2.1 time: 0.466790 Aug 17 11:21:32.232490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 21/37] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:31 2022] GET /compute/v2.1/os-volumes/c64d93bf-ae78-4a05-aec1-996aedd0113a => generated 109 bytes in 473 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:21:32.765183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1115092638", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43691234-0e70-4705-a16e-85460708cc3e"}], "security_groups": [{"name": "tempest-securitygroup--953463349"}], "key_name": "tempest-keypair-1086997901", "user_data": "}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:33.296241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:21:33.296722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:21:33.297385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:21:33.298008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:21:33.298600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:21:33.313361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:33.321996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:33.325046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:33.332191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:33.332925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:33.334023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:33.430711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] validate_networks() for [('43691234-0e70-4705-a16e-85460708cc3e', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:21:33.491250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Getting quotas for project 489c5e5efcdb4ffbb51513e79efcb4a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:21:33.506511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Getting quotas for user 5347450f8fe94a03b576b57597aaed82 and project 489c5e5efcdb4ffbb51513e79efcb4a2. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:21:33.562162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:21:33.571032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:21:33.802486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-18b81973-0a83-4ad6-96b6-5b53c363e116 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.310563 Aug 17 11:21:33.814940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 17/38] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:21:33.835226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:33.837875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:33.878110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:33.880373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:33.881981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:33.887100 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:33.912915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:33.913673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:34.436467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:34.467819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b7055fc0-b2d1-4887-886c-e51562696e52 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1279 microversion: 2.1 time: 0.649130 Aug 17 11:21:34.469935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 18/39] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:33 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1279 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:34.512606 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-571caa2b-e3ad-4603-9128-5209b3efe811 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90445545e0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:34.596967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-571caa2b-e3ad-4603-9128-5209b3efe811 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/50b2a34f-9996-49f3-bb2f-02fecb822d23" status: 200 len: 351 microversion: 2.1 time: 0.124910 Aug 17 11:21:34.597585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:34 2022] GET /compute/v2.1/os-volumes/50b2a34f-9996-49f3-bb2f-02fecb822d23 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:34.610003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-500c1b19-7b56-422e-b4d3-f8da06b5829a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:34.613732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-500c1b19-7b56-422e-b4d3-f8da06b5829a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:34.960022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-500c1b19-7b56-422e-b4d3-f8da06b5829a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:34.981710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-500c1b19-7b56-422e-b4d3-f8da06b5829a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1214 microversion: 2.1 time: 0.383021 Aug 17 11:21:34.988200 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:34 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1214 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:35.497700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:21:35.499327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:21:35.500098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:21:35.500591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:35.501039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:21:35.501261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:21:35.508508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:35.522833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:35.527085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:35.529167 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:35.531231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:35.532971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:35.533207 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:35.533959 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:35.535514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:35.536212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:35.536718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:35.537355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:35.539569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:35.587653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for project e247a3ec0a244abf9d11299cc53b9311. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:21:35.603373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for user 1e6765845c4c4960bfee00c6384e8a4b and project e247a3ec0a244abf9d11299cc53b9311. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:21:35.636262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:21:35.636882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:35.639345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:21:35.648475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c320e949-8ae1-4e18-89d6-ac39b3b5d043 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1279 microversion: 2.1 time: 0.162035 Aug 17 11:21:35.662856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:35 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:35.744545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e3e40036-273b-4f5d-9318-bbea8c0a2ac6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.987002 Aug 17 11:21:35.745349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 22/43] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 11:21:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 2989 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 17 11:21:35.757211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:35.758361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:35.833686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:35.843247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:35.845961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:35.847163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-28758a8c-3f9a-465f-ac2b-d3d5de5265b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1282 microversion: 2.20 time: 0.094646 Aug 17 11:21:35.848421 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:35 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:36.008675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:36.009544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:36.019617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.022849 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.023609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.027425 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.028145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.028760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.140199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:36.148955 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3a3d62dc-9770-4035-88d6-8f26535a102f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.144540 Aug 17 11:21:36.149498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 23/45] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:36 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:36.675694 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:36.677996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:36.708089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.712944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.713667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.715953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.716660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.718686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.871580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:36.872800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:36.883842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.884494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.885732 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.886535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:36.887214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:36.887885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:36.941041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:36.949184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-afadc578-76ec-4ae6-b594-3c906c99db5c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.282706 Aug 17 11:21:36.964716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:36 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:36.979976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:36.988280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:36.989836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:36.990951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4a728c6f-ffef-41fb-bd4c-f2606731ac8e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.124356 Aug 17 11:21:36.991510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 24/47] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:36 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:21:37.171581 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:37.172469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:37.178860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:37.179380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:37.179908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:37.180829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:37.181312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:37.182325 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:37.243028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:37.250778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d5952928-ea80-4f19-b159-4b3399c5f4a1 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.083386 Aug 17 11:21:37.251348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:37 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:37.974514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:37.975280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:37.981812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:37.982303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:37.982749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:37.983452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:37.983905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:37.984327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:38.013847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:38.014858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:38.043261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:38.043914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:38.049170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:38.051180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:38.052893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:38.062471 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:38.166533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:38.178712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:38.180556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:38.181891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-46181186-d832-44fa-beb8-d27ffec8073d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.172112 Aug 17 11:21:38.182457 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:38 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:21:38.207717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:38.220099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8367fc2e-2c37-4dad-a064-c776599e0414 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.245351 Aug 17 11:21:38.220099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:37 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:38.271907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:38.272690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:38.279531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:38.280036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:38.280475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:38.281198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:38.281708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:38.284226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:38.353302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:38.361157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5332965d-042e-4f1b-9f08-258818eb90d5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.093365 Aug 17 11:21:38.361735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 26/51] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:38 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:39.204744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:39.205409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:39.213830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.214328 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.222865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.223668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.224158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.224582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.239136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:39.240479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:39.249994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.251605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.252261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.253608 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.254460 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.255088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.391991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:39.400221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:39.401766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:39.402891 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f533d00b-6c8d-4f58-85c2-7ee81981303a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.202459 Aug 17 11:21:39.403599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 26/52] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:39 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:39.412591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:39.413244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:39.420250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.420937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.422326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.424128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:39.424128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:39.424400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:39.466162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:39.485856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8d1428c4-15dc-4d0f-a1b3-47b8ae2fcd44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.249527 Aug 17 11:21:39.486972 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:39 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:39.505785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:39.514452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1a3f98f0-7b28-4607-9a4c-e38c07a2f8b8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.109498 Aug 17 11:21:39.515336 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 27/54] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:39 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:39.631562 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7138f157-bd29-4e0c-948a-951de3a3daa9 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444f4430>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:39.711809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7138f157-bd29-4e0c-948a-951de3a3daa9 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/880cd8ec-0158-4876-b405-2927cdd6a234" status: 200 len: 351 microversion: 2.1 time: 0.085643 Aug 17 11:21:39.712523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 28/55] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:39 2022] GET /compute/v2.1/os-volumes/880cd8ec-0158-4876-b405-2927cdd6a234 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:40.431728 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:40.432988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:40.439819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.440576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.441010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.442281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.447665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.448335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.510964 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:40.511727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:40.519083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.522691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.531671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.532500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.533131 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.533596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.544618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:40.571723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:40.573340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:40.581322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5a38c449-7d84-4535-a65b-55f5c071116f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.152018 Aug 17 11:21:40.594037 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 28/56] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:40 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:40.601402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:40.606344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:40.633878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.634870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.635462 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.636300 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:40.637016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:40.637581 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:40.772199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:40.790221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9fa5780b-0faf-4954-9cc0-d7b5eae3cb90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.283171 Aug 17 11:21:40.810186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 29/57] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:40 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:40.853833 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:40.864155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f9ea3797-cf50-4ae0-8f7b-5c139acd5121 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.269612 Aug 17 11:21:40.864752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 29/58] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:40 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:41.218645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d82c4f04-9687-4680-a381-cd5a4a96f6ac tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444f4430>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.295196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d82c4f04-9687-4680-a381-cd5a4a96f6ac tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/181c9f00-4c45-462f-82e2-ebb67eb75659" status: 200 len: 351 microversion: 2.1 time: 0.084521 Aug 17 11:21:41.295912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes/181c9f00-4c45-462f-82e2-ebb67eb75659 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:41.308465 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9635c845-46e5-4abc-b12a-76ca136c08c0 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444e6dc0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.391611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9635c845-46e5-4abc-b12a-76ca136c08c0 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086895 Aug 17 11:21:41.392182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 30/60] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:41.405996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6472abec-018b-47b3-a9dd-b55ca32cc722 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444a0af0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.501399 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6472abec-018b-47b3-a9dd-b55ca32cc722 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.099081 Aug 17 11:21:41.502119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 31/61] 10.222.0.15 () {58 vars in 1149 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:41.518890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a6a1a1ce-d218-4bd1-a529-bed281cf689c tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f9044509040>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.606289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.611793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a6a1a1ce-d218-4bd1-a529-bed281cf689c tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.096590 Aug 17 11:21:41.612535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 31/62] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:41.619586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:41.625832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7f5c297b-0f56-4586-9119-53e5bf1d99d1 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f904452b280>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.631607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.632584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.633259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:41.634172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.642298 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.642856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:41.743423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:41.752527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:41.754224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:41.755748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-06be5ffa-ebc6-4036-bcdf-2c2e8b46aaae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.155132 Aug 17 11:21:41.756600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 32/63] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:21:41.772564 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7f5c297b-0f56-4586-9119-53e5bf1d99d1 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150963 Aug 17 11:21:41.773648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1167 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:41.788987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e79e0bb3-74f9-4bf4-ad55-75f9ca808c0f tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444bbee0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.816142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.816790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:41.823655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.824130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.824557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:41.825245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.825717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.826138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:41.924125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e79e0bb3-74f9-4bf4-ad55-75f9ca808c0f tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.139441 Aug 17 11:21:41.924986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1170 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:41.929881 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:41.931176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:41.939997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.940658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.941116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:41.942512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:41.942978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:41.943404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:42.019450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:42.031764 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-826c850e-6584-4150-a9f4-aede26d2b94d tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.105452 Aug 17 11:21:42.032338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 34/66] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:42.037179 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f0795aac-023d-42e6-adc8-b634a2c583e9 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90445009d0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:42.120639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:42.134197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fa6d7751-d4ba-4c0d-8c2a-ec30dd88a6d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.322135 Aug 17 11:21:42.144021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f0795aac-023d-42e6-adc8-b634a2c583e9 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.102201 Aug 17 11:21:42.144021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 35/67] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 11:21:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:42.145008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 33/68] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:41 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:42.157375 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8c10b720-9b45-4053-9ef5-aeaf0cfecda3 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444a0040>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:42.252885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8c10b720-9b45-4053-9ef5-aeaf0cfecda3 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099471 Aug 17 11:21:42.262288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1188 bytes} [Wed Aug 17 11:21:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:42.270833 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-771fb5a9-b191-4977-8bd8-a0e09ac010f3 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] Calling method '.version_select at 0x7f90444ff700>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:42.399096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-771fb5a9-b191-4977-8bd8-a0e09ac010f3 tempest-VolumesTestJSON-1282226333 tempest-VolumesTestJSON-1282226333-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.132740 Aug 17 11:21:42.400198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 11:21:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:42.782285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:42.782932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:42.789759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:42.790306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:42.790802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:42.791590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:42.792120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:42.792611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:42.854974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:42.864826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:42.866450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:42.867722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-481640b5-da14-4f71-afe0-bd78a2e40c89 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.089558 Aug 17 11:21:42.868305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 37/71] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:42 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:43.057012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:43.057659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:43.063960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.064401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.064826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.068354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.068354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.068354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.129286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:43.137175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-27b21a1d-f97d-4dd3-841c-84c72e812073 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.084044 Aug 17 11:21:43.137781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 35/72] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:43 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:43.156028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:43.156631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:43.162575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.163136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.163576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.164297 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.164727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.165155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.296314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:43.305030 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ed6779d1-e483-44e6-bcc4-8b02d70f36e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.152649 Aug 17 11:21:43.306379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 38/73] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:43 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:43.890062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:43.890675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:43.892637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:43.898211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.898783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.899221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.899910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:43.900357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:43.900786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:43.976663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:43.985797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:43.987587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:43.988893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2f29bb73-382b-476c-af92-733e9577befe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.102734 Aug 17 11:21:43.989700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 36/74] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:43 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:44.157821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:44.158441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:44.165015 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:44.170663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:44.171057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:44.171467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:44.172316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:44.172782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:44.173204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:44.237891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:44.246181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-71f3877d-56fe-4a63-8676-0327d9a12472 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.092131 Aug 17 11:21:44.246872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 39/75] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:44 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:44.327681 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:44.329344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:44.338128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:44.338975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:44.339612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:44.340479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:44.341206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:44.342021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:44.538307 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:44.548206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-23e53ba9-64f2-4db4-a14c-2cccd01b503e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.224656 Aug 17 11:21:44.554840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 37/76] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:44 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:45.011610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:45.012220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:45.018169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.018735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.019362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.020169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.020687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.021296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.109281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:45.119877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:45.122021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:45.125930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1f5b4c2e-961d-449c-bd0b-6c1e81062bc8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.115848 Aug 17 11:21:45.126539 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 40/77] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:45 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:45.266751 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:45.267642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:45.273814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.274497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.274990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.275692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.276630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.277157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.347257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:45.360498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c7ce529f-bc4f-49f0-8b8e-f61dee0bd5c7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.097759 Aug 17 11:21:45.361092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 38/78] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:45 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:45.575547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:45.576740 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:45.584458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.588106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.592743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.593561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:45.594134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:45.596154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:45.814010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:45.824120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-23044d32-a701-44e3-b169-17f71ac1cae4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.252786 Aug 17 11:21:45.825881 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 41/79] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:45 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:46.148709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:46.149606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:46.151767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:46.152779 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=24 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:46.161694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.162798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.163435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.164331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.164787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.165208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.232638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:46.241726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:46.243315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:46.244435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-840e6849-969c-486c-9f0f-516ac502c57f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.100073 Aug 17 11:21:46.244984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 39/80] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:46 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:46.384267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:46.384859 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:46.387934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=14 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:46.391816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.392294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.392729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.393448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.393899 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.394315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.455085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:46.462443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b7a78dd5-c185-45be-a7e6-cea3bdb5205a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.082875 Aug 17 11:21:46.463083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 42/81] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:46 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:46.844802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:46.845556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:46.851638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.852130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.852535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.853210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:46.853688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:46.854102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:46.994907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:47.002995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-af4e2fa5-8858-4d5a-86ec-e93287e9f18f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.162535 Aug 17 11:21:47.003563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 40/82] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:46 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:47.268468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:47.269014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:47.275212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:47.275692 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:47.276130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:47.276821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:47.277275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:47.277725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:47.281737 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:47.339134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:47.354277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:47.356026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:47.357227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6fa39e24-0a4b-4046-9fd4-313e8813cbc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1286 microversion: 2.20 time: 0.092906 Aug 17 11:21:47.357878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 43/83] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:47 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:47.484483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:47.485189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:47.491995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:47.492561 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:47.492968 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:47.493725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:47.494183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:47.494605 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:47.514234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:47.563262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:47.573703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7a2168e5-97ba-4ff0-b916-e0667e3eb71c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1218 microversion: 2.1 time: 0.092976 Aug 17 11:21:47.585935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 41/84] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:47 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:48.024619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:48.025624 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:48.037080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.039429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.040472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.043525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.045883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.046890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.328212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:48.338992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-30f90d7f-81ea-4597-93d9-37e571ed3405 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.319552 Aug 17 11:21:48.339863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 44/85] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:48 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:48.380234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:48.381148 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:48.387593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.388353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.389021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.390066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.390719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.391484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.512643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:48.522599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:48.524974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:48.528222 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-75859c52-0fec-4ebb-b39a-ce00e99c6a11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1334 microversion: 2.20 time: 0.150226 Aug 17 11:21:48.529438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 42/86] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:48 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1334 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:48.595599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:48.596315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:48.604697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.605193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.605670 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.611892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:48.612597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:48.613188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:48.784291 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:48.797270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-61e880d7-0d88-49da-8a6a-4ff342a8bc82 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1274 microversion: 2.1 time: 0.205385 Aug 17 11:21:48.798206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 45/87] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:48 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:49.361789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:49.363969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:49.388287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.392673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.395415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.396583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.400216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.400935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.473002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2", "tag": "663da14f-9922-4188-8480-48ee8990935e"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:49.512491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.514049 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.514751 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.543558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Creating event network-changed:663da14f-9922-4188-8480-48ee8990935e for instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 on hv-cinder-85345 Aug 17 11:21:49.544596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 11:21:49.545174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-464aed78-5243-4d3d-9a33-b1e483ef67a3 req-09e01b84-5d2b-4b13-8a33-01d22fbb62ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=120583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 11:21:49.546591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.547317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.547893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.548924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.549712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.550314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.564391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.compute.rpcapi [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 11:21:49.565671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] Releasing lock "compute-rpcapi-router" {{(pid=120583) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 11:21:49.608535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6dc13d11-0d64-4dfd-b1f6-68a0f8fa502f None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282074 Aug 17 11:21:49.610227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 43/88] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:49.619899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:49.620841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:49.641292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.642090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.643337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.644595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.645278 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.647344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.832714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:49.842123 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:49.844769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:49.846963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:49.848365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3edfd7c8-127b-485b-9151-96f865e43f6e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1340 microversion: 2.20 time: 0.235365 Aug 17 11:21:49.849624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 44/89] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:49 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1340 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:49.852079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4b2b0aa8-861f-429e-8da7-dbad02450de1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.495787 Aug 17 11:21:49.853160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:49 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:49.858594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:49.859451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:49.866752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.867969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.868409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.869570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.870025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.870445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.921574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaec248d-889a-4d44-8bca-0de312ec1cb5", "tag": "d9e663d4-7e87-41de-a96a-dc3196a24e5c"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:49.937431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:49.938510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:49.939039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:49.952839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] Creating event network-changed:d9e663d4-7e87-41de-a96a-dc3196a24e5c for instance aaec248d-889a-4d44-8bca-0de312ec1cb5 on hv-cinder-85345 Aug 17 11:21:49.960634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-6742f820-09ea-49c4-aeff-1bfdda72c7b0 req-0eee2c7a-df12-4ed4-a1b4-bb84adc4f78b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109275 Aug 17 11:21:49.961566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 45/91] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:50.021652 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:50.041536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-69343a01-4d97-43cd-a17c-3c3de6a9cbcc tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1272 microversion: 2.1 time: 0.187168 Aug 17 11:21:50.042138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:49 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:50.877617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:50.879527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:50.890817 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:50.892204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:50.902266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:50.902772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:50.903204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:50.904193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:50.904807 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:50.907096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:50.908888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:50.909349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:50.909780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:50.910353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:50.910981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:50.913714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:51.385104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:51.394498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:51.396480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:51.398349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-19903fdf-f141-46b5-83a9-3e5ae0ed891a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.513087 Aug 17 11:21:51.399912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 48/93] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:50 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:51.400947 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:51.405075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:51.405998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:51.412990 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:51.416599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-20b528c4-9ab3-4607-b972-8e8849d1e0a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.543298 Aug 17 11:21:51.416779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:51.417297 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:51.418598 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:51.419134 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 46/94] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:50 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:51.419830 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:51.420449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:51.590794 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:51.600538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7d51b75c-ceb1-47d5-bde5-3a5e381dcbb5 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.199406 Aug 17 11:21:51.614370 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:51 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:52.421330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:52.422493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:52.432124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.433650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.439051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:52.440306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:52.449798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:52.450994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.451975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.456373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.457141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:52.461465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.463578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:52.466328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.469055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.475775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:52.851321 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:52.857338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:52.862200 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-13bcf9ef-9742-4186-b11b-eb4592469b90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.426976 Aug 17 11:21:52.865349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 50/96] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:52 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:21:52.870336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:52.870906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:52.874579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:52.876107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b33ece66-6b0e-492d-a76b-d94bc08a93a9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.459717 Aug 17 11:21:52.878683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:52.884159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 47/97] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:52 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:52.894156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.894556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.895097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:52.896173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:52.896278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:52.896708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.385865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:53.399142 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2255b565-bfc8-4449-8c02-8be40c8ed856 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.532450 Aug 17 11:21:53.399877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 51/98] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:52 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:53.650645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:53.664253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.665112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.665759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.679270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] Creating event network-changed:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:21:53.703295 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-c1eb24a1-213a-454f-8920-a13337a1602b req-b9599c00-005f-4ed1-87cf-1e560284ab1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054686 Aug 17 11:21:53.705713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 48/99] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:21:53.879250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9ac9b7-5690-43b9-b995-eb854d25c009", "tag": "cd25983e-2c7c-4067-a5a9-e178477bea73"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:53.886072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:53.886921 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:53.900818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.902716 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.902965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.906759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.908655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.909440 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.915874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.916705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.917337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.944124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Creating event network-changed:cd25983e-2c7c-4067-a5a9-e178477bea73 for instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 on hv-cinder-85345 Aug 17 11:21:53.945196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120584) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 11:21:53.945897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-107855e9-15aa-4cbf-a57b-eec75d83df44 req-fdf16bf0-7391-467f-ac4c-7cdda7f7c9b1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120584) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 11:21:53.947474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.947934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.949033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.950366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:53.951039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:53.951467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:53.962260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.compute.rpcapi [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 11:21:53.963199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] Releasing lock "compute-rpcapi-router" {{(pid=120584) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 11:21:53.981925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1f2c2fe9-d81a-41cc-9e21-f33fd3656f91 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108548 Aug 17 11:21:53.983561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 52/100] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:53.991666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:53.992729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:54.003356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:54.004476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:54.005107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:54.006343 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:54.006980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:54.008404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:54.075126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:54.090793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ed3f971f-dc9b-4b85-a3b5-ea7c18e98080 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.209388 Aug 17 11:21:54.091386 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:53 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:54.186539 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:54.199676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:54.201410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:54.202566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c07c8aee-6f82-427a-adbf-4146a0bc367a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.217376 Aug 17 11:21:54.208760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 53/102] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:53 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:54.421873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:54.422740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:54.430268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:54.430762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:54.431195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:54.432077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:54.432538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:54.433084 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:54.599417 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:54.607782 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8c70ee21-fc26-402b-9d76-1d10d0f7cd61 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.189840 Aug 17 11:21:54.608691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 50/103] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:54 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:55.112516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:55.113206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:55.120283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:55.127303 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.132536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.133234 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.134224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.135101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.135722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.224835 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:55.226382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:55.240476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.241224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.244725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.245707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.246340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.247023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.837272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:55.853616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:55.856841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:55.858509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2cdd0d98-1ec5-4b83-839d-1ab58d4fbb2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.637612 Aug 17 11:21:55.862253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 51/104] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:55 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:55.873115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:55.874320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:55.895860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.896507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.911210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.912213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:55.912889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:55.913549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:55.923546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:55.932747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-da4dbdc1-92e0-4621-8807-d9080749938f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.824419 Aug 17 11:21:55.939347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 54/105] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:55 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:56.340303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:56.358229 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-592e3737-5941-450f-8539-82ec46825a4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.494478 Aug 17 11:21:56.358826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 52/106] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:55 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:56.885102 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:56.888082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:56.902849 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:56.905997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:56.906858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:56.909059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:56.910589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:56.912248 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:56.967444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:56.968491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:56.980286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:56.989964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:56.992205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:56.996167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:56.997394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:56.998006 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:57.479483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:57.480160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:57.489189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:57.490293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-25e51688-f40b-401e-a1e5-100c4e2b18d5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.528800 Aug 17 11:21:57.490927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 53/107] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:56 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:57.492739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:57.494045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8dc4556c-f3b1-4845-9b3b-7986f3677272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.614306 Aug 17 11:21:57.494620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 55/108] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:56 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:57.515331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:57.517656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:57.527077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:57.527558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:57.527995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:57.528678 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:57.529119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:57.529726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:57.679027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:57.688117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-39bd4898-30f7-4ace-8358-00f12903b24c tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.184705 Aug 17 11:21:57.688706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 54/109] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:57 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:58.519574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:58.520153 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:58.521851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:58.522888 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:58.533664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.535123 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.535782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.536562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.537175 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:58.538123 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:58.539069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.540163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.541992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.542399 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.546297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:58.546747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:58.831805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:58.843664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-66a2f1fe-adf6-486e-9713-10c36eb5d7e7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.327781 Aug 17 11:21:58.844328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:58 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:58.857607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:58.867312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:58.869383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:58.870793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ae864799-2061-4338-9ed5-205fe18081a6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.358585 Aug 17 11:21:58.872343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 55/111] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:58 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:21:58.877552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:58.878432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:58.885899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.886553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.887219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:58.898268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:58.899024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:58.899450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:59.120963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:21:59.128739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2", "name": "network-vif-plugged", "status": "completed", "tag": "663da14f-9922-4188-8480-48ee8990935e"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:21:59.130353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cf083569-ed44-41c2-a958-beb25982eeb8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.256891 Aug 17 11:21:59.131096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 56/112] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:58 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:21:59.139450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:59.140371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:59.141338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:59.153895 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] Creating event network-vif-plugged:663da14f-9922-4188-8480-48ee8990935e for instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 on hv-cinder-85345 Aug 17 11:21:59.163386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-76141a72-9487-4f01-8902-fdfd2a27b93f req-b1bcae2c-6411-4b97-8997-c9cd732fc8e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317826 Aug 17 11:21:59.164072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 57/113] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:21:59.864558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:59.865756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:59.872535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:59.881184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:59.882082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:59.882667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:59.883607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:59.884257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:59.885228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:59.898980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:21:59.899687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:21:59.931953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:59.935543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:59.936000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:21:59.943488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:21:59.944307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:21:59.944480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:00.217676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:00.220415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:00.231183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:00.231344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f0d38f7a-92a6-4927-a4e3-efe0ff913b92 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.370792 Aug 17 11:22:00.233758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:00.234767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 57/114] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:21:59 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:00.236149 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b9c42c3b-f39d-4d50-856a-b64124469d11 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.341526 Aug 17 11:22:00.237465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 58/115] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:21:59 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:00.241329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:00.244511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:00.257445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:00.258481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:00.258909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:00.259893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:00.260344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:00.262792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:00.441256 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:00.449336 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a15124d3-4acf-4689-af2f-36fbf4fa0577 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.213512 Aug 17 11:22:00.449939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:00 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:01.261025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:01.261671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:01.266298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:01.267573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:01.268340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.268796 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.269462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.270355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.270977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.271580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.274550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.275583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.276427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.277303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.277989 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.278703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.492447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:01.495724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:01.498808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:01.503443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-368bc2ec-96a2-4e8a-9e0d-68d34cfeb9dd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.247147 Aug 17 11:22:01.504030 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 59/117] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:01 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:01.508677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:01.509507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:01.515171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.515390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:01.516047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.516712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.517454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:01.517596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:01.518121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:01.518559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:01.518707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fe277223-0a44-4ca4-9249-7c80dfc394bc tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.258241 Aug 17 11:22:01.519593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 59/118] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:01 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:01.659031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:01.662567 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:01.667315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1bb66f4e-6b8d-4255-9869-c8dbd51b02a8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.162196 Aug 17 11:22:01.668053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 60/119] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:01 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:02.524900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:02.525545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:02.531635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.532161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.532602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.533334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.533842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.534360 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.540838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:02.541661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:02.551434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.552010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.552623 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.553348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.553958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.554559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.730745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:02.738368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6cf6b61b-5b92-498e-9118-5d165ee32787 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.218026 Aug 17 11:22:02.739034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 60/120] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:02 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:02.743166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:02.743984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:02.744716 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:02.750610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.751092 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:02.751826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.752452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.752569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:02.753464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:02.753693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-30cc7346-51bc-405b-a9e5-4d7e83c889bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.216764 Aug 17 11:22:02.753944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:02.754339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:02.757930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 61/121] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:02 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:02.881171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:02.892880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8897d48f-0b17-4678-bf87-c6c13dcd5a5f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.152484 Aug 17 11:22:02.895466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 61/122] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:02 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:03.540452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec248d-889a-4d44-8bca-0de312ec1cb5", "name": "network-vif-plugged", "status": "completed", "tag": "d9e663d4-7e87-41de-a96a-dc3196a24e5c"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:03.566398 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.568136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:03.568780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:03.589196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] Creating event network-vif-plugged:d9e663d4-7e87-41de-a96a-dc3196a24e5c for instance aaec248d-889a-4d44-8bca-0de312ec1cb5 on hv-cinder-85345 Aug 17 11:22:03.594333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-bc474fc3-3221-4286-afce-289cd80664ec req-91f5f145-ce29-4f84-a747-877c702a5cb6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058224 Aug 17 11:22:03.594929 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 62/123] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:03.759147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:03.759896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:03.766341 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.766816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:03.767249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:03.768244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.768684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:03.769116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:03.777970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:03.779163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:03.786662 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.787229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:03.787905 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:03.789064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.789767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:03.790489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:03.962558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:03.971846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:03.980539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b572288b-eb88-47be-b214-63bf12e094e1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.225770 Aug 17 11:22:03.985445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 62/124] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:03 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:03.990229 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:03.990811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:03.998340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:03.998912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:04.000098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:04.000283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:04.000895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:04.001483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:04.001980 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:04.010503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:04.012272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:04.013746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bd6f6283-0507-4b92-8f1b-3d0410c90256 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.240781 Aug 17 11:22:04.014709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 63/125] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:03 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:04.141696 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:04.149314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1674bb21-2fa1-4a57-9964-194880bc5554 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.162859 Aug 17 11:22:04.149897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 63/126] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:03 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:05.002727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:05.003893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:05.010749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.011233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.011781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.012594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.013164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.013624 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.051899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:05.059509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:05.067077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.067565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.068044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.068957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.069414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.069884 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.217082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:05.226946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7004fa12-584a-4cb7-b611-97d70e73d298 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.228169 Aug 17 11:22:05.227800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 64/127] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:04 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:05.245913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:05.246684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:05.247529 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:05.253177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.253802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.254406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.255128 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:05.255692 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:05.256210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:05.257685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:05.259662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:05.261001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-aad40f86-5ac0-44a1-a31b-4eae1119f060 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.228126 Aug 17 11:22:05.261904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 64/128] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:05 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:05.277397 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1797590576", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "networks": [{"uuid": "a062f878-fdd4-4cf7-8c6d-565819198076"}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:05.347936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] validate_networks() for [('a062f878-fdd4-4cf7-8c6d-565819198076', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:22:05.477566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:05.485206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9fb89390-e1b3-40c0-ab46-1f904a8ce838 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.243211 Aug 17 11:22:05.485815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 65/129] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:05 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:06.113928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:22:06.114461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:22:06.114868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:22:06.115270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:22:06.115730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:22:06.127720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.128207 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.128668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.129698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.130868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.131300 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.151503 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Getting quotas for project 2e6406e8acf64333a2e0c46e556fb8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:22:06.155710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Getting quotas for user 62f6fcee54dc4c2e82c340a3e7615dda and project 2e6406e8acf64333a2e0c46e556fb8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:22:06.166905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:22:06.169120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:22:06.216208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-afdb06bf-c689-42b2-bb52-503be2f4d3dd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953075 Aug 17 11:22:06.217042 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 65/130] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:22:06.228353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8b6feddd-95be-4d42-85e0-74f0d2810e11 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:06.228971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8b6feddd-95be-4d42-85e0-74f0d2810e11 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:06.252044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:06.252435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:06.259366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.260117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.260557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.261514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.262393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.263376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.315414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8b6feddd-95be-4d42-85e0-74f0d2810e11 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.324096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8b6feddd-95be-4d42-85e0-74f0d2810e11 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1214 microversion: 2.1 time: 0.099666 Aug 17 11:22:06.325024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:06 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:06.366511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:06.367296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:06.375314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.375786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.376346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.377085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.377578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.377995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.484204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.493627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-beaa493e-e9be-480b-bcfd-2ebc9552a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.246789 Aug 17 11:22:06.495454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:06 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:06.505786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:06.506403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:06.516542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.517496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.522040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.522894 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:06.523373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:06.523963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:06.574534 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.585219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.587155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.588274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-de4b1716-bcdc-4f46-a65b-660747e526f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.233039 Aug 17 11:22:06.588966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 67/133] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:06 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:06.714434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:06.723496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-81731467-15da-4d8b-9db3-4b575cdb2e05 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.221546 Aug 17 11:22:06.724056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 67/134] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:06 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:07.348023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:07.348628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:07.354903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.355468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.355803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.356601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.356956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.357373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.426934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.435963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-950c7de4-36f7-4e29-9343-a5e1b44d5127 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1218 microversion: 2.1 time: 0.091343 Aug 17 11:22:07.436555 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:07 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:07.516817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:07.517589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:07.523617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.524097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.524522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.525208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.525858 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.526277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.611613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:07.612982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:07.621279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.622025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.622730 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.623778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.624616 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.625768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.724387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.733907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3e25af01-d077-41cd-95bc-d951e15ac574 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.220990 Aug 17 11:22:07.735184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:07 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:07.751924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:07.752899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:07.760175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.761058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.761632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.762377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:07.763049 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:07.763719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:07.817459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.826174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.827760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.828861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-abed04df-bef4-4eb0-b3b8-0f8d482d1fc2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.221166 Aug 17 11:22:07.829593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 69/137] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:07 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:07.910668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:07.918769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4f66de72-9a09-479c-a536-01379ec191db tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.178079 Aug 17 11:22:07.919342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:07 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:08.456736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:08.457337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:08.463364 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.463848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.464278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.464957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.465406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.465855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.525914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:08.533322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bad5fe20-c3fe-45f6-9191-9abeae8e5a7f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1218 microversion: 2.1 time: 0.080464 Aug 17 11:22:08.533908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:08 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:08.759981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:08.759981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:08.763148 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.763671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.764147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.764832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.765339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.765765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.857110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:08.858084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:08.864405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.865152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.865840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.866893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.867577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.868078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.923487 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:08.931055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-21799207-597f-49d1-a7fd-035c8e8ce125 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.179410 Aug 17 11:22:08.931640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:08 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:08.939533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:08.940201 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:08.946714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.947193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.947634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:08.948311 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:08.948796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:08.949214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:09.034836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:09.043622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:09.045252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:09.046472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-33f11546-a6fb-4a8c-8a0e-374bd980a5e6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.199174 Aug 17 11:22:09.047113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 71/141] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:08 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:09.093829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:09.101671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1f3aed1d-ad0f-43ef-9ac7-0aad9a5d03eb tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.165688 Aug 17 11:22:09.102234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 71/142] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:08 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:09.554166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:09.554783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:09.562100 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:09.562580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:09.563001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:09.563740 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:09.564124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:09.564537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:09.628801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:09.636644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3a508766-4dc9-4d57-8708-b57e98043f36 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1218 microversion: 2.1 time: 0.086383 Aug 17 11:22:09.637522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 72/143] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:09 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:09.952613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:09.953210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:09.959282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:09.959793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:09.960216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:09.960924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:09.961369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:09.961805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.068358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:10.068962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:10.075494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.075987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.076413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.077189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.077712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.078103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.095546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.103381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f74e4e45-da3c-493d-b3a6-6e8387ce1395 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.154517 Aug 17 11:22:10.103835 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 72/144] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:09 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:10.122838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:10.123432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:10.129793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.130274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.130703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.131383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.131824 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.132267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.273908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.282146 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.283632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.284728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cc01f9b9-3d0e-4a0f-902b-b62246d0ab80 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.220373 Aug 17 11:22:10.285275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 73/145] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:10 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:10.297800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.305612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a1b1f43b-eeb6-41d6-9e60-7f170f3891be tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.186891 Aug 17 11:22:10.306265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:10 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:10.657548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:10.658107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:10.664526 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.665021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.665455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.666148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:10.666595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:10.667002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:10.726732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:10.734032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bb0eb4d9-29bb-480a-9e1d-72e29e58f4fc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1218 microversion: 2.1 time: 0.080418 Aug 17 11:22:10.734603 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 74/147] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:10 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:11.123934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:11.124723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:11.131636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.132306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.132978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.133992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.134648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.135368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.267313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.274749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-901231d9-e91a-4b14-8cb3-dbf47bfcaa8e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.154634 Aug 17 11:22:11.275311 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:11 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:11.307960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:11.308743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:11.314585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.315075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.315493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.316162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.316605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.316996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.327245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:11.327911 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:11.335010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.335552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.336152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.336885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.337374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.337856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.526250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.530775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.534965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.536709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.537835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4ddd627e-1a2e-49ce-b2ed-b611883689fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.233830 Aug 17 11:22:11.538267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1ce6aaf8-4ccf-4d67-a4a9-bf32f55ee0b9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.214916 Aug 17 11:22:11.538396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 75/149] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:11 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:11.549602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:11 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:11.754696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:11.755379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:11.761394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.761902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.762333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.763014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:11.763467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:11.763870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:11.827393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:11.835053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a3d608d6-c11b-4492-971d-eb97aeb53085 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1210 microversion: 2.1 time: 0.084706 Aug 17 11:22:11.835809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:11 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:12.295512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:12.296342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:12.304008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.304986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.305645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.306736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.308303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.309153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.469885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.478023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-74bb49b1-7be8-4dbf-9aae-f8cb15808d36 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.186385 Aug 17 11:22:12.478890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:12 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:12.558545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:12.559669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:12.560186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:12.560861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:12.567186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.567383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.567882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.568165 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.568535 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.568670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.569516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.569989 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.570451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.578707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.579265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.579888 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.584479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:12.775711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.783505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0fe8efe3-b50d-493a-908a-3a6d59cbbd6f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.229011 Aug 17 11:22:12.784169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:12 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:12.789923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.797897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.799368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.800454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-31de9843-60da-4ebd-b282-bb102b725aae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.244340 Aug 17 11:22:12.800961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 77/154] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:12 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:12.859459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:12.860338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:12.869016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.869767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.870395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.871368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:12.872020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:12.872633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:12.938918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:12.946640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ace38584-ebb1-4c1c-bb62-5ac2a28c3ece tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1266 microversion: 2.1 time: 0.092592 Aug 17 11:22:12.947176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:12 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:13.499015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:13.499625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:13.505708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.506188 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.506609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:13.507339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.517239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.517239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:13.640121 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:13.647403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f5792255-c5c7-4287-8d77-0748ac1e1303 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.152214 Aug 17 11:22:13.648071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:13 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:13.804391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:13.805005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:13.811082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.811579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.811984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:13.812678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.813119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.813561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:13.817378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:13.823522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:13.824160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:13.826081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:13.831235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.831714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.834737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:13.835574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:13.836100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:13.836524 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:14.019159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.022261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.031750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.032823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bd78a311-4011-4186-9ffa-9c94b7281992 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.232324 Aug 17 11:22:14.033493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:13 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:14.038201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:14.038502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.038971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:14.043619 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9c847d3c-83ce-4189-91da-3614e6c8247d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.224673 Aug 17 11:22:14.044363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 79/158] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:13 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:14.055184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:14.055792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:14.056449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:14.057250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:14.058019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:14.058542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:14.121654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.129328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2770c32c-049e-4622-9bfd-8daeb2a1e120 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1266 microversion: 2.1 time: 0.094571 Aug 17 11:22:14.129980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 80/159] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:14 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:14.671943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:14.672958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:14.681951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:14.682442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:14.682873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:14.683595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:14.684048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:14.684474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:14.823075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:14.830960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e4cdb4df-9415-4661-9515-e6d319e88829 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.165507 Aug 17 11:22:14.831531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:14 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:15.054765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:15.055362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:15.062248 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.062783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.063236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.064016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.064517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.064980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.066435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:15.067114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:15.074005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.074499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.074930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.075624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.076081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.076503 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.253820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:15.256760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:15.262982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8f23a84c-2e82-47ef-924f-af4d6d838984 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.212694 Aug 17 11:22:15.263579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:15 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:15.264953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:15.266435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:15.267766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2550ef70-a7ef-47cd-b279-2edc3bea37cb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.205589 Aug 17 11:22:15.268461 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:15.268593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 81/162] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:15 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:15.268850 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:15.274816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.275295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.275726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.276404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.276852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.277278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.339079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:15.346433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5cecdc8c-cfc3-49f6-a3dc-99e7d3ee61c8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1266 microversion: 2.1 time: 0.081909 Aug 17 11:22:15.347106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:15 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:15.851804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:15.852320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:15.858627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.859110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.859539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.860219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:15.860668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:15.861085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:15.992532 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.000171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5995f667-6863-406b-900d-39b6d77f7acd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.152390 Aug 17 11:22:16.000740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:15 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:16.289117 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:16.290198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:16.294762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:16.295759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:16.298669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.299709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.300787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.301987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.302873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.304088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.304591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.305040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.307436 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.307908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.308335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.309016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.309465 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.309914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.323369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.502150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.505617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.513772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-04863821-0171-4571-9e50-f4e0db5e7784 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.231943 Aug 17 11:22:16.514308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:16 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:16.514785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.516297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.517452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bd189ff5-74ea-461d-95d9-9eee8ae023b9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.230106 Aug 17 11:22:16.517974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 83/166] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:16 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:16.524135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:16.524736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:16.530679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.531152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.531574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.532244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:16.532684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:16.533079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:16.593634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:16.602060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5d8fe882-c919-4b91-bae3-a100bb9435b1 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1266 microversion: 2.1 time: 0.086225 Aug 17 11:22:16.602667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 84/167] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:16 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:17.030452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:17.031736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:17.040628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.041317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.042377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.043749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.044437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.044998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.180578 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.188227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-409331c8-04ea-4c77-a76d-b489485ab6b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.163297 Aug 17 11:22:17.188799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:17 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:17.534084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:17.534885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:17.540670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:17.540670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:17.541985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.542654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.543683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.544488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.545040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.545785 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.548742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.549941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.550419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.551484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.551953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.552398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.767192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.767192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.768367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.769481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-27d8cea9-a7cd-43ca-9a7a-4e6ef7c249ec tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.233759 Aug 17 11:22:17.770041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 85/169] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:17 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:17.774464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:17.775063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:17.780745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.781408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.781880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.782558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.783000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.783410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.789281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.800878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d6756bfe-915a-4a19-bc6b-ed9f3dc105c0 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.269938 Aug 17 11:22:17.810753 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 85/170] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:17 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:17.816066 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9ac9b7-5690-43b9-b995-eb854d25c009", "name": "network-vif-plugged", "status": "completed", "tag": "cd25983e-2c7c-4067-a5a9-e178477bea73"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:17.826762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:17.827241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:17.827675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:17.846409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] Creating event network-vif-plugged:cd25983e-2c7c-4067-a5a9-e178477bea73 for instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 on hv-cinder-85345 Aug 17 11:22:17.851886 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-ea8e7657-d302-4929-946c-e8a0d0341c25 req-0c60ea40-a72f-4340-8cf1-a8a163be0bec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039485 Aug 17 11:22:17.852633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 86/171] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:17.854281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:17.861844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1a9d9897-3980-431a-90f5-9c7a6ea82d40 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1266 microversion: 2.1 time: 0.090766 Aug 17 11:22:17.862405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:17 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:18.210085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:18.210807 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:18.217145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.217644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.218072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:18.218747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.219194 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.219596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:18.348019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:18.359847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bcf71de4-6860-4f21-a22d-d8c130dbedae tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1321 microversion: 2.1 time: 0.153691 Aug 17 11:22:18.360636 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 87/173] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:18 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:18.792181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:18.792790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:18.799287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.799791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.800250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:18.800933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.801372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.801997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:18.829696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:18.831105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:18.837280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.837806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.838246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:18.838916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:18.839556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:18.840152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.006545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.014520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.016072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.017216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e3df1138-3e7a-4a9e-b917-192e98a88e67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.229538 Aug 17 11:22:19.017766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 87/174] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:18 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:19.022813 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:19.023304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:19.029618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.029975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.030114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.030518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.031199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.031638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.032221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.037594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c566e661-fa0e-4d2f-b27a-6e3ad819516b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.211556 Aug 17 11:22:19.038195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:18 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:19.093636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.101159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-50852719-c967-4b5e-9dcd-710ee64d0281 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1274 microversion: 2.1 time: 0.082265 Aug 17 11:22:19.101752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 88/176] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:19 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:19.385113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:19.385753 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:19.392238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.392719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.393152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.393875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.394331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.394754 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.536978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.544884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5c2d943b-d3a0-44d0-ad3e-60077bf6ceb2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1514 microversion: 2.1 time: 0.164578 Aug 17 11:22:19.545448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:19 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:19.565982 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:19.568309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:19.574868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.575346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.575774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.576488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.576933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.577356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.647309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lazy-loading 'flavor' on Instance uuid a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:22:19.770293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0617599e-7f80-474f-8b50-9d5e9a2be930 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2/action" status: 200 len: 32 microversion: 2.1 time: 0.207886 Aug 17 11:22:19.770903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 89/178] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:22:19 2022] POST /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:22:19.780809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:19.781448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:19.787419 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.787910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.788389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.789113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.789599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.790025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.881194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "name": "network-vif-plugged", "status": "completed", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:19.891128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:19.891527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:19.891943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:19.903224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] Creating event network-vif-plugged:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:22:19.908438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-96c58736-8796-4750-b993-97e1339d41dc req-7bc2360e-98f8-4c79-9596-4e59e7473f2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031339 Aug 17 11:22:19.909029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 90/179] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:19.924627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:19.932316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e21c6cdd-5a31-4fd3-94d4-101b3256e4a7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.155309 Aug 17 11:22:19.933029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:19 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:20.040135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:20.040817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:20.047450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.047922 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.048345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.049017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.049468 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.049915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.058495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:20.059107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:20.065271 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.065806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.066239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.066930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.067411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.067831 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.268865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:20.275213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:20.279887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:20.281454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:20.282602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d1aa5d07-6d05-4e07-ba64-673837c0f6ad tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.246793 Aug 17 11:22:20.283170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 91/181] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:20 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:20.286883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7b195826-bc0a-4eb0-9f91-04c83295ad1f tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.232269 Aug 17 11:22:20.287622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:20 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:20.291408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:20.292199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:20.298726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.299223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.299617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.300297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.300736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.301144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.319431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:20.369744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:20.377256 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7213e18e-62db-4002-a1a1-c190a5029abb tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1274 microversion: 2.1 time: 0.093087 Aug 17 11:22:20.377877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:20 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:20.952806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:20.953409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:20.959764 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.960325 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.960760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:20.961451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:20.961936 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:20.962357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.093014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.100715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3fcd9b90-bd0d-42eb-b1ab-4ea459fcce5b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.151681 Aug 17 11:22:21.101284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:20 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:21.307305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:21.307843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:21.308584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:21.309224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:21.314151 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.314627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.315051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.315164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.315618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.315731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.316050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.316168 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.316559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.316764 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.317209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.317659 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.503907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.507155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.512288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.513846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.514692 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a3195226-aa9e-428e-915f-474e3627e8d7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.209886 Aug 17 11:22:21.514925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-726e8ec9-019c-483e-adaf-95fb49b0b0e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.212497 Aug 17 11:22:21.515228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 93/185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:21 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:21.515705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 93/186] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:21 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:21.520556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:21.521243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:21.527268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.527835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.528340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.529027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:21.529506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:21.529922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:21.590402 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:21.598236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5b97a40f-2111-4b1d-97eb-c884468f740c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1274 microversion: 2.1 time: 0.081193 Aug 17 11:22:21.598779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 94/187] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:21 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:22.134761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:22.135687 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:22.147766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.148320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.148880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.149840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.150511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.151072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.289202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.297305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-647d721b-b36f-4b27-9855-29d910476ae0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.171041 Aug 17 11:22:22.297906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:22 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:22.535485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:22.536120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:22.537158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:22.538533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:22.543614 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.544091 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.544506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.544969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.545209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.545621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.545725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.546108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.546361 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.547103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.547627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.548109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.753930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.757705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.762265 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f45c267e-340b-4d1c-b19f-a53ebd361650 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.230701 Aug 17 11:22:22.762927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:22 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:22.767435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:22.767669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.768227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:22.769874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.771844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cd0f19d8-79c1-4a46-ae2e-ab0c1fb0c736 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.238862 Aug 17 11:22:22.773087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 95/190] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:22 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:22.775546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.776095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.776529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.777228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:22.777765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:22.778344 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:22.797108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:22.841987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:22.849718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fdb2ce5d-0c00-4420-83b0-fdb6c80770b2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1284 microversion: 2.1 time: 0.085704 Aug 17 11:22:22.850405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:22 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:23.321739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:23.322240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:23.328562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.329044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.329479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.330168 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.330644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.331063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.545323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:23.555849 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2cd5e469-4051-422c-b70c-017120d899b7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.239947 Aug 17 11:22:23.556490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 96/192] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:23 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:23.783304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:23.783916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:23.790043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.790516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.790949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.791615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.792046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.792463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.795265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:23.795866 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:23.803829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.804310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.804728 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.805404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:23.805871 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:23.806280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:23.984973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:23.993220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-99e0713b-6ce6-4bb6-a2bc-07e74c71e482 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.213880 Aug 17 11:22:23.993828 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 97/193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:23 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:23.998977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:23.999559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:24.006136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:24.006957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:24.007433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:24.008157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:24.008722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:24.009213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:24.009333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:24.017759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:24.019410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:24.020484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2d719409-ed14-4d55-8b8e-b9ea739a26dd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.229255 Aug 17 11:22:24.021035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 97/194] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:23 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:24.095126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:24.105671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-503842b3-f237-46de-98f6-a4620b566068 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1272 microversion: 2.1 time: 0.110593 Aug 17 11:22:24.106251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 98/195] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:23 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:24.576739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:24.578684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:24.585528 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:24.586203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:24.586634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:24.587395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:24.587844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:24.588297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:24.948378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:24.962170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e35d7ed2-c568-4ac1-9662-28561f4feeb1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.389369 Aug 17 11:22:24.962747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 98/196] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:24 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:25.014969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:25.016151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:25.027290 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.027787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.028333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.029111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.029673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.031827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.049843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:25.050837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:25.064494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.064927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.066921 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.067658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.068148 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.068531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.277973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:25.286884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-955f5218-dfff-439f-939b-334a7805e31b tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.276620 Aug 17 11:22:25.290450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 99/197] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:25 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:25.295359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:25.295970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:25.301249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=94 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:25.306097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:25.306346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.306871 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.307311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.308396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.309001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.309619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.316638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:25.319501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:25.321912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-610b50f2-69cc-4035-9516-f965690d1b3d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.278856 Aug 17 11:22:25.322898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 99/198] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:25 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:25.474870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:25.483010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-918d3fac-ec53-4976-8280-114452f46b21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.191231 Aug 17 11:22:25.483593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 100/199] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:25 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:25.985020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:25.985720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:25.992514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.993349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.993974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:25.995026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:25.995629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:25.996187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.146638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.155374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b7f14a40-b5c7-459c-a3a9-c53e3afb0969 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.175646 Aug 17 11:22:26.168135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 100/200] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:25 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:26.312791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:26.315477 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:26.327039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.327756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.328482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.330151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.330774 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.331488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.350101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:26.350774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:26.359133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.359526 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.362145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.365395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.365964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.366335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.650387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.654156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.658956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.660432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.661551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-abe771d0-b5c9-459f-b5f2-098365eea30c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.316092 Aug 17 11:22:26.662804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 101/201] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:26 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:22:26.668639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:26.669390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:26.676431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.677297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.678162 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.679379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:26.679987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:26.680856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:26.700122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a92f8d65-ff0c-461b-863c-08e1999cc936 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.375271 Aug 17 11:22:26.716041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 101/202] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:26 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:26.919118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:26.931379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f5b37b17-a640-45e1-8063-90506aceceee tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.267204 Aug 17 11:22:26.932539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 102/203] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:26 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:27.177860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:27.178596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:27.195301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.196266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.196709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.197575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.198057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.198628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.377735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:27.390077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7ec6475d-000c-43d2-8258-758659215b29 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.215986 Aug 17 11:22:27.391496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 102/204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:27 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:27.688727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:27.689345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:27.695607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.696401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.696834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.697556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.698015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.698434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.725492 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:27.726569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:27.732517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.733208 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.733937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.734824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.735632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.736189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.916405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:27.925472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:27.926656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:27.927769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4ae34a72-718e-4742-94d9-1583219eb641 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.244109 Aug 17 11:22:27.928541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 103/205] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:27 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:27.952188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:27.955211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:27.955826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:27.963570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ceb52f43-876e-48e6-8f3b-553faf7f9aa2 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.241832 Aug 17 11:22:27.963850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.964419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.964593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 103/206] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:27 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:27.965012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:27.965824 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:27.966345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:27.966857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.121223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:28.128710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-71b0cec6-3204-4a1c-b396-9bd39ac32cff tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.178050 Aug 17 11:22:28.129276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 104/207] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:27 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:28.412864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:28.414974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:28.422869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.423354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.424053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.424902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.425514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.426173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.570201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:28.578296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d721bc17-098d-4dc0-b164-d0295b128c90 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.170584 Aug 17 11:22:28.578869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 104/208] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:28 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:28.956983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:28.957699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:28.963756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.964236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.964658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.965351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.965839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.966252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.986274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:28.987068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:28.994486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.995059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.995505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:28.996521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:28.996984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:28.997458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:29.213826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.219536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.227459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-991940df-ef1b-40a8-9521-e15f5c5d9111 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.244900 Aug 17 11:22:29.228034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 105/209] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:28 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:29.236317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.236317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.236317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6e609601-7f91-46cd-8177-b8928d8b272a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.286551 Aug 17 11:22:29.236809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 105/210] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:28 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:29.242309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:29.243247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:29.252220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:29.252916 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:29.253602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:29.255303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:29.256704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:29.257359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:29.410387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.418758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f208af1c-43eb-40c5-b498-6b283cdac456 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.181066 Aug 17 11:22:29.419507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 106/211] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:29 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:29.599814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:29.600494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:29.606387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:29.606876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:29.607313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:29.608003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:29.608453 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:29.608866 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:29.775159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:29.782548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-aa88bd33-96c5-415d-b22f-e7502ec75735 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.186767 Aug 17 11:22:29.783106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:29 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:30.254882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:30.255605 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:30.259690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:30.260522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:30.265109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.265880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.266534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.267510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.268101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.268660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.268937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.269582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.270181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.271106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.271730 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.272395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.485362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:30.494965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:30.496125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-113f6d41-a298-414e-b284-99e26533f8f8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.247420 Aug 17 11:22:30.508477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 107/213] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:30 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:30.513047 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:30.514440 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:30.519540 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:30.521397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:30.522758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.523247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4c6a4b82-0c9b-433e-8e5c-a28f5317c93b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.268696 Aug 17 11:22:30.523688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.524263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 107/214] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:30 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:30.524965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.525948 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.526408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.526828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.776768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:30.784264 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c60bb2ff-8fb7-440f-abab-4a118df24cdc tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.286155 Aug 17 11:22:30.784823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 108/215] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:30 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:30.803053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:30.803694 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:30.810454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.810454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.810745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:30.811348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:30.811796 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:30.812219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.043783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.052570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ad7a4386-a983-408c-9dc0-0290f13c007d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.253251 Aug 17 11:22:31.053140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 108/216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:30 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:31.157651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482167a8-d6b4-48b0-b9aa-6fd7ea8251bc", "tag": "070dc432-c70d-4aac-9007-61419057b121"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:31.167216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.167693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.168118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.171842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:31.180698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] Creating event network-changed:070dc432-c70d-4aac-9007-61419057b121 for instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc on hv-cinder-85345 Aug 17 11:22:31.185854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a7defb7e-a1e1-40ad-9906-cd6baf2786e4 req-1618c205-796b-4f7a-ba50-fc65d70be4ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031901 Aug 17 11:22:31.186456 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 109/217] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:31.516458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:31.517060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:31.523610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.524157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.524581 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.525259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.525716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.526155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.545998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:31.546684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:31.552867 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.553331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.553795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.554496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.554934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.555349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.720355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.727940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-96825be8-5dea-4d47-86e7-9ba7d50bedca tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1314 microversion: 2.1 time: 0.215405 Aug 17 11:22:31.728473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 109/218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:31 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:31.744276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.752947 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.754503 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.755646 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-513744e9-f27b-4e58-b3cd-eb542861ab04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1407 microversion: 2.20 time: 0.213895 Aug 17 11:22:31.756246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 110/219] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:31 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:31.807479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:31.808858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:31.815155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.815756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.816259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.817067 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:31.817719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:31.818145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:31.948420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:31.957227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-42aa5ce5-7e64-4d57-a543-bcc4d1922c24 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.153970 Aug 17 11:22:31.957866 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:31 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:32.073354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:32.073988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:32.079863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.080337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.080746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:32.081449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.081901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.082315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:32.212603 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:32.220256 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9d4095ad-aac5-424d-9fb8-2ae068d9bf6c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.150927 Aug 17 11:22:32.220810 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 111/221] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:32 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:32.754062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:32.755490 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:32.766979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.767780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.768506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:32.769665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.770444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.771148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:32.779298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:32.780586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:32.788095 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.788629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.789109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:32.790054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:32.790683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:32.791432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.073895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.076620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.084851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.085933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-87c8c2eb-6432-47e4-b6b3-cf0c02c1dd4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1500 microversion: 2.1 time: 0.339713 Aug 17 11:22:33.097446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.097446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-db6f9ffb-31da-47dc-be95-2396eecd144b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1600 microversion: 2.20 time: 0.313192 Aug 17 11:22:33.097446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 112/222] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:22:32 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1600 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:22:33.097446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:33.098031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:33.098828 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 111/223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:32 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:33.103431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.103431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.103431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.104073 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.105045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.105994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.117050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:33.117863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:33.124339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.125200 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.125767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.126645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.127166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.127643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.320343 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6e1ddb78-731b-47ee-8f5c-b7948c56e9fb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.207268 Aug 17 11:22:33.321563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 112/224] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 11:22:33 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:22:33.326968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:33.327705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:33.334533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.335056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.335490 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.336244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:33.336701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:33.337124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:33.349461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.356569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:33.357029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d775ff3f-1f88-4050-8907-0bf58fbed223 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.267328 Aug 17 11:22:33.357628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 113/225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:33 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:33.521398 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:33.531578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0ff6e6b1-1614-405d-9ea9-3058d9d93c8d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.208493 Aug 17 11:22:33.532233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 113/226] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:33 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:34.376915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:34.377572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:34.385370 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:34.385884 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:34.386315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:34.387021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:34.387456 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:34.387877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:34.540054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:34.552313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-eae78ba0-33ec-4b73-8f80-fad47d9e98ca tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.179086 Aug 17 11:22:34.553289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 114/227] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:34 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:34.553766 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:34.554523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:34.562069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:34.562553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:34.562992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:34.566802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:34.567288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:34.567722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:34.751010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:34.759551 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4afb665f-d694-4d4d-88b0-09046fc87a07 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.210009 Aug 17 11:22:34.760334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 114/228] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:34 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:35.076293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:35.088236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:35.088921 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:35.089368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:35.101350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] Creating event network-changed:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:22:35.106704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-f934b51a-2577-4014-9dd8-528d36391f4e req-0cbc57cf-7aed-4c04-bdb7-3f91199230af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Aug 17 11:22:35.107616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 115/229] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:35.573679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:35.574192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:35.580574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:35.581056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:35.581673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:35.582361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:35.582778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:35.583320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:35.718061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:35.727218 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-888c6b6e-de54-478f-a4e4-657a715bdbec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.157843 Aug 17 11:22:35.727802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 115/230] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:35 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:35.780710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:35.781407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:35.787720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:35.788215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:35.788641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:35.789331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:35.789805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:35.790224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:35.921912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:35.929869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d4887324-6f62-436d-9488-fc7f967c522a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.153352 Aug 17 11:22:35.930478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 116/231] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:35 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:36.751789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:36.752809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:36.760841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:36.761331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:36.761941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:36.762609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:36.762996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:36.763416 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:36.894839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:36.906008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f9ede386-e2ec-47d8-b66a-295efb105ced tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.160321 Aug 17 11:22:36.906748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 116/232] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:36 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:36.951240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:36.951861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:36.958324 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:36.958809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:36.959243 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:36.959983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:36.960439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:36.960868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:37.091958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:37.099574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e3455a5a-9c66-4964-b48d-84a8e8601dfa tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.152339 Aug 17 11:22:37.100231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:36 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:37.927321 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:37.927924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:37.934699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:37.935183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:37.935611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:37.936296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:37.936745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:37.937162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:38.074311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:38.085317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5696e008-f98a-4ad8-8281-0e8c7948e00d tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.161867 Aug 17 11:22:38.085926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:37 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:38.120445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:38.121057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:38.127266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:38.127744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:38.128177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:38.128860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:38.129307 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:38.129768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:38.440585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:38.448789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1030f066-95d9-406c-9d69-89e07233c955 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.332247 Aug 17 11:22:38.449368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 118/235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:38 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:39.110332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:39.111449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:39.121629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:39.122424 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:39.123145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:39.124273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:39.125018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:39.125799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:39.257025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:39.264833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-07aab680-9b31-4414-b518-bafca28468ec tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.161024 Aug 17 11:22:39.265401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:39 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:39.475192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:39.476349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:39.487162 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:39.488092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:39.488919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:39.490251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:39.491156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:39.491641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:39.624823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:39.632641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9f42a7ee-4cf8-4993-b12c-30aca4cd7fc8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.165376 Aug 17 11:22:39.633214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 119/237] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:39 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:40.289802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:40.290772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:40.301155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:40.302017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:40.302739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:40.303708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:40.304162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:40.304594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:40.435525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:40.443298 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4eb2b1ac-dbb4-4d70-8080-0611281a4ee9 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.160101 Aug 17 11:22:40.443915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:40 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:40.653677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:40.654302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:40.660323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:40.660807 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:40.661210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:40.661925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:40.662377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:40.662846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:40.799316 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:40.808710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4058d7e4-e722-495b-b5d3-f3a88eec6847 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.158907 Aug 17 11:22:40.809296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 120/239] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:40 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:41.464823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:41.465393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:41.471675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:41.472157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:41.472579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:41.473253 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:41.473736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:41.474149 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:41.603335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:41.610856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8bee30c5-25b7-4e82-b401-9e6b59141096 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.149830 Aug 17 11:22:41.611423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 120/240] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:41 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:41.833795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:41.834745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:41.841032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:41.841552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:41.841979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:41.842665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:41.843119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:41.843540 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:41.978631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:41.991255 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-77856dbe-d5ee-40d5-b775-4e03134b0702 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.163767 Aug 17 11:22:41.992177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 121/241] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:41 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:42.634506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:42.635145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:42.641775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:42.642279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:42.642726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:42.643439 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:42.643909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:42.644346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:42.773910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:42.781689 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-73b2739e-c3c6-42c4-9f87-f1391ebc7e66 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.152118 Aug 17 11:22:42.782248 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 121/242] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:42 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:43.018103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:43.018709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:43.024744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:43.025225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:43.025687 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:43.026367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:43.026811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:43.027233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:43.160720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:43.168992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-32562290-31cb-4d47-8a56-6dbfedfa5bd5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.154669 Aug 17 11:22:43.169576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 122/243] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:43 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:43.805113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:43.805745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:43.812082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:43.812558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:43.813090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:43.813781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:43.814261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:43.814676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:43.955977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:43.963804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7d96dce6-6bdc-42e0-99fa-250ac04c2b43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.164122 Aug 17 11:22:43.964367 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 122/244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:43 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:44.189923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:44.190604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:44.192749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=88 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:44.198377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:44.198863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:44.199309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:44.199999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:44.200440 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:44.200852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:44.330983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:44.342312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0cacfe99-a6aa-4146-82e3-f81cacf69626 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.156037 Aug 17 11:22:44.343064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 123/245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:44 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:44.988588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:44.989622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:44.999686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:45.000474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:45.001201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:45.002364 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:45.003107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:45.003812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:45.137845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:45.148147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-492b6b5b-abd0-4d0a-81f4-659ee721b78f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.165824 Aug 17 11:22:45.148836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 123/246] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:44 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:45.367962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:45.368730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:45.377177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:45.377866 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:45.378445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:45.379374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:45.379952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:45.380515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:45.515541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:45.523487 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2e2a744a-3f54-4db5-b363-e2d41d86eee5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.160737 Aug 17 11:22:45.524055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 124/247] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:45 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:46.175061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:46.176240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:46.182368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:46.182855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:46.183293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:46.184190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:46.184418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:46.185147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:46.359224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:46.366755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-55edc6cd-6812-4bc7-8a5a-b1f92bb8639b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.196393 Aug 17 11:22:46.367356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 124/248] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:46 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:46.545009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:46.545574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:46.554041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:46.554901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:46.555546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:46.556669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:46.557414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:46.558156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:46.708430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:46.716035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4e9c146b-0986-4fa2-8208-85365844f153 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.175345 Aug 17 11:22:46.729253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 125/249] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:46 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:47.369042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165d9aa0-871d-4020-8973-c8aab02f36ad"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:47.371629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:47.378376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.378866 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.379294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.379984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.381147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.381147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.386748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:47.387362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:47.394023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.394506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.394932 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.395819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.396239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.396702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.524068 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:47.532138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8fb949c8-fc36-497b-9a08-300e3e1ebdc8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.149217 Aug 17 11:22:47.532737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 126/250] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:47 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:22:47.739968 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:47.740996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:47.747916 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.748442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.748913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.749704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:47.750199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:47.750659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:47.755857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:47.890101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:47.898248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5d322f2d-6f2e-490f-acd3-355480570f3a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.164562 Aug 17 11:22:47.898830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 127/251] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:47 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:48.554398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:48.554912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:48.561280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:48.561797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:48.562228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:48.562914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:48.563363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:48.563785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:48.707064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:48.719193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-815c070e-8c85-4254-963a-5f9c58e0ac43 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.168506 Aug 17 11:22:48.720047 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 128/252] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:48 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:48.924175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:48.925268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:48.933648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:48.934395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:48.935118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:48.936239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:48.937032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:48.937783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:49.086485 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:49.094449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f875042e-2eca-49a0-9e8a-b1adfc9cf44d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.177531 Aug 17 11:22:49.094988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 129/253] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:48 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:49.742143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:49.742752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:49.749062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:49.749575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:49.750009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:49.750669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:49.751152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:49.751575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:49.885662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:49.893547 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-dfa336e0-7299-4205-a357-7fe7deb4fb2a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.156267 Aug 17 11:22:49.894429 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 130/254] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:49 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:50.117110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:50.117962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:50.125715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:50.126233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:50.126770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:50.127605 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:50.128181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:50.128702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:50.268943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:50.280425 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-167e9042-ac9c-4999-aee5-569d71d1e7f8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.167931 Aug 17 11:22:50.281106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 131/255] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:50 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:50.916333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:50.916933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:50.923113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:50.923592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:50.924016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:50.924694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:50.925140 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:50.925587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:51.071453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:51.079534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-42b4e3bf-6c1c-4a7b-8e90-1eff5630fd2c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.167483 Aug 17 11:22:51.080361 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 132/256] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:50 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:51.167657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-810af77c-12c7-4fd6-b179-c5fd86089b62 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "POST /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.802348 Aug 17 11:22:51.168226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 125/257] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:22:47 2022] POST /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009/os-volume_attachments => generated 194 bytes in 3804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:51.305124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:51.305922 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:51.313591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:51.314205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:51.314742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:51.315605 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:51.316235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:51.316818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:51.450030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:51.457457 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2ae921bf-baf7-40c9-81d7-a63adceb6c95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.158421 Aug 17 11:22:51.458053 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 133/258] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:51 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:52.101400 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:52.102487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:52.110373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:52.110897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:52.111339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:52.112054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:52.112576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:52.113014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:52.280132 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:52.287779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-061434fd-4d7e-43e1-89e3-d046bc099895 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.190747 Aug 17 11:22:52.288341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 126/259] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:52 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:52.479554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:52.480280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:52.487289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:52.487908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:52.488451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:52.489253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:52.489787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:52.490298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:52.648371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:52.655731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0e712cde-48e5-4fac-8350-78aebfcd7ecd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.181106 Aug 17 11:22:52.656286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 134/260] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:52 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:53.308914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:53.311346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:53.319847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:53.320949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:53.321406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:53.322136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:53.322580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:53.322992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:53.458180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:53.465729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f37f6688-ead6-4520-b566-4e569075d8f3 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.161396 Aug 17 11:22:53.466479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 127/261] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:53 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:53.563138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482167a8-d6b4-48b0-b9aa-6fd7ea8251bc", "name": "network-vif-plugged", "status": "completed", "tag": "070dc432-c70d-4aac-9007-61419057b121"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:22:53.574710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:53.575906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:53.576345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:53.588157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] Creating event network-vif-plugged:070dc432-c70d-4aac-9007-61419057b121 for instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc on hv-cinder-85345 Aug 17 11:22:53.593486 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-12f41616-ade2-4c11-acb8-552f52f9e1fa req-339d13a6-3eaf-4572-9b34-871eb092a89a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035104 Aug 17 11:22:53.594452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 135/262] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:22:53.677051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:53.677923 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:53.687253 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:53.688122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:53.688707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:53.689653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:53.690307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:53.690733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:53.915094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:53.919031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:53.927466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b928488b-b0fa-4e8c-8e84-f87895b7687d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.254581 Aug 17 11:22:53.928229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 128/263] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:53 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:54.489242 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:54.489947 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:54.496776 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:54.497262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:54.497758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:54.498454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:54.498905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:54.499330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:54.633743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:54.641447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6589652c-3927-4d62-8d18-fea7a4d3fc83 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.158043 Aug 17 11:22:54.642303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 136/264] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:54 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:54.948713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:54.950571 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:54.959887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:54.960447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:54.961011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:54.961764 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:54.962487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:54.962996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:55.117656 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:55.125021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9a929197-e497-4f71-ad3d-befe617a6a1c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.180732 Aug 17 11:22:55.125619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 129/265] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:54 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:55.662104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:55.663205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:55.669542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:55.670221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:55.670819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:55.671802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:55.672251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:55.672876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:55.819264 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:55.831189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-52463670-59d1-483a-898f-2cc2e8fc4ac2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1314 microversion: 2.1 time: 0.172767 Aug 17 11:22:55.832497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 137/266] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:55 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:56.147214 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:56.148338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:56.150900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=60 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:56.157322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:56.158002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:56.158581 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:56.159452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:56.160041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:56.160602 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:56.334416 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:56.342083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9c676ef5-f3dc-4ce7-88b7-a2efe2bc7d11 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.199201 Aug 17 11:22:56.343841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 130/267] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:56 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:56.857514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:56.858185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:56.864879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:56.865639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:56.866172 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:56.867502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:56.871731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:56.872206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:57.018870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:57.028275 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-673d23da-c5c7-472c-959d-883bbbbb0e21 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1499 microversion: 2.1 time: 0.178112 Aug 17 11:22:57.028841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 138/268] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:56 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1499 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:57.364257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:57.365694 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:57.374117 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:57.374846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:57.375514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:57.376580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:57.377307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:57.377968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:57.588695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:57.597822 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-87e062f4-ebb4-44e8-98a7-cb6ba30c13cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.238427 Aug 17 11:22:57.598322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 131/269] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:57 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:58.623473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:58.624175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:58.630373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:58.631043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:58.631487 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:58.632237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:58.632753 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:58.633249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:58.780125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:58.789843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-be62e475-27d0-4a65-aadc-274ea65d1973 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.174414 Aug 17 11:22:58.790434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 139/270] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:58 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:22:59.812171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:22:59.812976 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:22:59.820073 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:59.821098 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:59.821553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:59.822349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:22:59.822861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:22:59.823391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:22:59.968172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:22:59.976009 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7f9822fe-7bc2-48f9-8c68-38c38a9ebbea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.168766 Aug 17 11:22:59.976645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 132/271] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:22:59 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:00.996127 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:00.996736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:01.002829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:01.003310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:01.003741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:01.004422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:01.004873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:01.005309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:01.138206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:01.146558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-544c6ddc-ef53-4660-bb11-e8628f9023ed tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.154173 Aug 17 11:23:01.147327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 140/272] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:00 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:02.168272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:02.168964 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:02.175356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.176099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.176723 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.177707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.178318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.178743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.322744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:02.330865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-637f4485-0454-433b-ac25-f523446dc5ab tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.166583 Aug 17 11:23:02.331440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 133/273] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:02 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:02.646501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:02.647202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:02.653640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.654193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.654563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.655213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.655850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.656442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.687176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:23:02.813568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f2cdef80-63cc-4095-a0e1-2eed82d17d5f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "DELETE /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 204 len: 0 microversion: 2.1 time: 0.170836 Aug 17 11:23:02.814543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 141/274] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:23:02 2022] DELETE /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 11:23:02.822900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:02.823782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:02.834957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.835527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.836027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.836950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:02.837593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:02.838170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:02.990737 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:02.999880 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-14d387ca-ed03-4fd7-907a-a88b963a2a0f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.181108 Aug 17 11:23:03.001084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 134/275] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:02 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:03.354220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:03.355393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:03.363988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:03.364931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:03.365618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:03.366778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:03.367377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:03.368062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:03.503869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:03.508187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:03.513773 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-87ff777b-c46d-4bb1-84e8-71cfb14c22c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.163969 Aug 17 11:23:03.514332 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 142/276] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:03 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:04.021735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:04.022435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:04.028634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:04.029110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:04.029575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:04.030259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:04.030695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:04.031111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:04.164676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:04.172016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-61fbbf38-356c-4186-b863-b52727835ab0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.154165 Aug 17 11:23:04.172575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 135/277] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:04 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:04.536846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:04.537645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:04.545805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:04.546298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:04.546750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:04.547461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:04.547906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:04.548313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:04.696413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:04.704744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ee664931-bb28-40d9-844b-a81b20ae6c14 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.173724 Aug 17 11:23:04.717444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 143/278] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:04 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:05.192359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:05.193251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:05.202249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.202737 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.203325 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.204028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.204491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.204909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.353627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:05.362289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2032805c-0d3f-4969-b14b-468f23f63ef0 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.173794 Aug 17 11:23:05.363204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 136/279] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:05 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:05.451811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:05.452306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:05.458482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.459212 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.459639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.460329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.460774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.461190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.491402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:23:05.608917 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cd32b3b3-d634-4a05-bea7-ba9dd4b99089 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 204 len: 0 microversion: 2.1 time: 0.160807 Aug 17 11:23:05.609510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 144/280] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:23:05 2022] DELETE /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:23:05.618161 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:05.618878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:05.624751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.625319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.625841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.626611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.627123 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.627604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.731405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:05.734161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:05.746999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.747407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.748345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.749070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:05.751292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:05.751720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:05.787587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:05.800327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4becdd79-2e0f-4702-855f-12262bc5e2a7 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.186162 Aug 17 11:23:05.803366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 137/281] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:05 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:05.975155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:05.984727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-41ab4614-2d94-4e79-9faf-4e77bea8fa76 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.260729 Aug 17 11:23:05.986067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 145/282] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:05 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:06.384987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:06.387904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:06.396589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:06.397327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:06.397985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:06.398820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:06.399486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:06.400136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:06.588312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:06.599431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f8e2d14e-7428-49e4-ab40-d9507ca50c16 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.219204 Aug 17 11:23:06.614261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 138/283] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:06 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:06.828131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:06.829951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:06.838979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:06.845740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:06.846473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:06.847527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:06.848128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:06.851497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:07.007631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:07.008296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:07.016819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:07.017316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:07.017825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:07.018527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:07.019053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:07.019406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:07.062157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:07.073218 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0c35f85a-53e6-4d19-9417-68eb6d9519b6 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.248935 Aug 17 11:23:07.074953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 146/284] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:06 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:07.294022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:07.301709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1b27703d-0428-4d48-a13a-c344a458a2f6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.298506 Aug 17 11:23:07.302353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 139/285] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:07 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:07.621136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:07.622103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:07.635303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:07.636280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:07.636952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:07.638008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:07.638660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:07.639506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:07.833375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:07.844745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f941159c-09f9-4cc2-859b-08dd40485bac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.227210 Aug 17 11:23:07.850978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 147/286] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:07 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:08.096189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:08.096951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:08.108493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.110385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.111068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:08.112060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.115615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.116322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:08.327305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:08.328105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:08.335903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.336924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.337485 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:08.338195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.338813 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.339402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:08.403242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:08.418401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d76dba61-53b8-424c-a839-c2d2406dec93 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.327030 Aug 17 11:23:08.419007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 140/287] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:08 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:08.874718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:08.875738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:08.918420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.922715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.924574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:08.925576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:08.931754 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:08.932689 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:09.058633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:09.066775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-21d8fb58-768e-4355-8655-23243fcbb0b4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.743939 Aug 17 11:23:09.067359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 148/288] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:08 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:09.328602 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:09.355525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-00871f7c-0af0-4115-bb9b-b115a95ef4ea tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.482200 Aug 17 11:23:09.358085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 141/289] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:08 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:09.440279 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:09.440892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:09.449004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:09.449291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:09.449812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:09.450430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:09.450861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:09.451282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:09.704289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:09.724144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-45ea801c-7508-4b1f-b889-e23711cc88e9 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.287624 Aug 17 11:23:09.726314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 149/290] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:09 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:10.089960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:10.090673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:10.113706 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.114114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.117180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.120316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.122085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.126266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.381951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:10.383859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:10.414525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.416711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.417264 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.418174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.418832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.419807 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.696155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:10.709472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bef84ade-ed98-4ca0-92b6-0e1c2e209e82 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.621642 Aug 17 11:23:10.710116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 142/291] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:10 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:10.765984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:10.766997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:10.774578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.776001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.776407 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.777133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:10.777642 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:10.778072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:10.905089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:10.928240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-83d34439-a147-4977-ad41-708fe9d93743 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.551280 Aug 17 11:23:10.929019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 150/292] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:10 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:11.051944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:11.062566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-479fdeeb-bc98-4b4e-b075-f17bb3a6319a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.314685 Aug 17 11:23:11.073443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 143/293] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:10 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:11.732964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:11.733677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:11.741707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:11.742054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:11.742510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:11.743704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:11.744563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:11.745090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:11.941700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:11.951673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:11.952638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:11.955690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4c9f1951-e342-4ad1-aec4-36e6d228bc55 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.224389 Aug 17 11:23:11.958428 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 151/294] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:11 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:11.970204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:11.970802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:11.971296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:11.972215 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:11.972852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:11.973480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:12.085101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:12.086124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:12.097790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:12.099280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:12.100665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:12.102041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:12.111676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:12.112235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:12.180525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:12.189946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-daa05672-1e83-4d01-819a-e2696507b401 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1505 microversion: 2.1 time: 0.242747 Aug 17 11:23:12.190968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 144/295] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:11 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:12.282594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:12.291841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bec388ce-2935-452c-b1a2-129704e1758a tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.211226 Aug 17 11:23:12.292933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 152/296] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:12 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:12.983063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:12.984435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:12.995793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:12.998616 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:12.999293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.001553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.003831 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.004576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.048583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:13.216558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:13.224373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-190a60ff-bb6f-4c86-864a-9458a6615f47 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1520 microversion: 2.1 time: 0.245414 Aug 17 11:23:13.227301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 145/297] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:12 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:13.227989 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:13.229156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:13.251596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.252098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.252527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.253236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.255874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.256309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.312496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:13.313098 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:13.323838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.326511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.327957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.336463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.337165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.337898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.448452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:13.469048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5698c29e-c697-4516-9d0e-3369207c3ef8 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1463 microversion: 2.1 time: 0.257617 Aug 17 11:23:13.470640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 153/298] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:13 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1463 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:13.485244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482167a8-d6b4-48b0-b9aa-6fd7ea8251bc", "name": "network-vif-deleted", "tag": "070dc432-c70d-4aac-9007-61419057b121"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:13.513927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:13.514878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:13.516131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:13.536234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] Creating event network-vif-deleted:070dc432-c70d-4aac-9007-61419057b121 for instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc on hv-cinder-85345 Aug 17 11:23:13.556378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-ab8ca539-73db-45d6-8c65-e568b1a07455 req-c1a6bf83-d6c7-4ae7-9573-8044eb8d2f5c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080919 Aug 17 11:23:13.557606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 154/299] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:13.782167 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:13.793439 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c1b1037b-c9a4-492c-892a-4369ec641776 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1552 microversion: 2.1 time: 0.484901 Aug 17 11:23:13.805791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 146/300] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:13 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1552 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:14.247815 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:14.249562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:14.260260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:14.265708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.270504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.282666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.283736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.298901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.299354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.494732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:14.496691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:14.503961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.504656 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.505276 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.506467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.507062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.507626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.558561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.560143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.561897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.562767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lazy-loading 'fault' on Instance uuid 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:23:14.695098 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:14.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6cdc73ee-d7f4-4f51-b7c5-7e10dfd8322c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 200 len: 1304 microversion: 2.1 time: 0.231909 Aug 17 11:23:14.721679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 147/301] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:14 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:14.748976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:14.762690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c9dc1d0c-7ab3-4ced-862c-c458905a3d20 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1500 microversion: 2.1 time: 0.521552 Aug 17 11:23:14.763535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 155/302] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:14 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:14.789061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:14.790156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:14.810508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.811240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.813615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.815045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.818388 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.820854 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.828882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:14.830153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:14.854910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.858545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.858545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:14.858827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:14.866085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:14.866579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:15.657074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5347450f8fe94a03b576b57597aaed82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489c5e5efcdb4ffbb51513e79efcb4a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:15.675155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f8a7ee6f-5dd7-48a7-93c3-49b44eb7ddd8 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 200 len: 1510 microversion: 2.1 time: 0.850343 Aug 17 11:23:15.675758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 156/303] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:14 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 1510 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:15.686381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9ac9b7-5690-43b9-b995-eb854d25c009", "name": "network-vif-deleted", "tag": "cd25983e-2c7c-4067-a5a9-e178477bea73"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:15.698253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:15.698737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:15.699165 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:15.715446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] Creating event network-vif-deleted:cd25983e-2c7c-4067-a5a9-e178477bea73 for instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 on hv-cinder-85345 Aug 17 11:23:15.720591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-f5455042-46bf-403d-9666-08eeb01d2167 req-cb7460d0-8ce8-4368-b814-f2ccfa59a085 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038530 Aug 17 11:23:15.721172 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 157/304] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:15.744388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:15.745481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:15.755984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:15.756929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:15.757686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:15.759933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:15.763557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:15.767109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:15.798421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] HTTP exception thrown: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Request method failure captured: Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc HTTP/1.1 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M9YhTBW8Y9BS7RFEBSar60y7UfSWyZolyAl34a96XkiR2GNNf1kwnEVNEkBrRgvmhTW07qPp4s64i7UBVNIn8JX9E44SknCE8-k8FLTWmlCFssAHUbchWZxKJQnwSLHg2Xs76C_FPUm0XiyqYyhNu0HHumhM72i9zjl3imdss3ZfJo Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 2e6406e8acf64333a2e0c46e556fb8b7 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:15.806822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2e6406e8acf64333a2e0c46e556fb8b7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 2e6406e8acf64333a2e0c46e556fb8b7 Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesActionsTest-1761505044-project Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 62f6fcee54dc4c2e82c340a3e7615dda Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesActionsTest-1761505044-project Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. Aug 17 11:23:15.808159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '482167a8-d6b4-48b0-b9aa-6fd7ea8251bc'} Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:15.808889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. Aug 17 11:23:15.814376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:15.816593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Returning 404 to user: Instance 482167a8-d6b4-48b0-b9aa-6fd7ea8251bc could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:15.817755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-49f04b83-1e70-4996-959d-588bcbf387e2 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc" status: 404 len: 111 microversion: 2.1 time: 0.080570 Aug 17 11:23:15.818317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 158/305] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:15 2022] GET /compute/v2.1/servers/482167a8-d6b4-48b0-b9aa-6fd7ea8251bc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:23:16.022735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1030868391", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "networks": [{"uuid": "a062f878-fdd4-4cf7-8c6d-565819198076"}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:16.116970 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] validate_networks() for [('a062f878-fdd4-4cf7-8c6d-565819198076', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:23:16.181592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:16.190309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5de4d044-5b82-4ef4-a75f-3fe7215fad0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1516 microversion: 2.1 time: 1.406068 Aug 17 11:23:16.193401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 148/306] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:14 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1516 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:16.699597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:16.700228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:16.724130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:16.724667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:16.733550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:16.734462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:16.734952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:16.735389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:16.764640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] HTTP exception thrown: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Request method failure captured: Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 HTTP/1.1 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M83QiWmVlJLpJPYLtCfOwpr8UnS4--LDF-SMqSpO4FDfpdA2M7ChlDGIvU2rbvC4McPs_R3yTzyGCwfquTQn31yO91078uVRr9ZP5CYK_J7Kzev_Q8egGAktQcU9We4kDWFyxQ3CbKvqUX67WcSU3tk4h_1tMt0O-b8Ba6l9uvvbss Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:23:16.780935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_489c5e5efcdb4ffbb51513e79efcb4a2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 5347450f8fe94a03b576b57597aaed82 Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:16.782315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '8e9ac9b7-5690-43b9-b995-eb854d25c009'} Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:16.783087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:16.785104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:16.787512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Returning 404 to user: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:16.787512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-df3d38db-ae07-47ca-92d5-c504054e0616 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 404 len: 111 microversion: 2.1 time: 0.090302 Aug 17 11:23:16.794833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 149/307] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:16 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:17.137646 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:17.140108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:17.148629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:17.153324 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:17.154306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:17.155377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:17.156520 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:17.158428 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:17.183048 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] HTTP exception thrown: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Request method failure captured: Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009/os-volume_attachments HTTP/1.1 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M83QiWmVlJLpJPYLtCfOwpr8UnS4--LDF-SMqSpO4FDfpdA2M7ChlDGIvU2rbvC4McPs_R3yTzyGCwfquTQn31yO91078uVRr9ZP5CYK_J7Kzev_Q8egGAktQcU9We4kDWFyxQ3CbKvqUX67WcSU3tk4h_1tMt0O-b8Ba6l9uvvbss Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:23:17.191527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_489c5e5efcdb4ffbb51513e79efcb4a2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 5347450f8fe94a03b576b57597aaed82 Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:17.193178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'server_id': '8e9ac9b7-5690-43b9-b995-eb854d25c009'} Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:17.194040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:17.195160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:17.196516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Returning 404 to user: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:17.196516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-54a8f938-c706-4f4f-91be-2bf1a2b50e4e tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060370 Aug 17 11:23:17.196516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 150/308] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:23:17 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:23:17.380425 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:23:17.381785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:23:17.383138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:23:17.383990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:23:17.384544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:23:17.405576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:17.407410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:17.408010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:17.410000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:17.412395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:17.413743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:17.490893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Getting quotas for project 2e6406e8acf64333a2e0c46e556fb8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:23:17.507533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Getting quotas for user 62f6fcee54dc4c2e82c340a3e7615dda and project 2e6406e8acf64333a2e0c46e556fb8b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:23:17.554497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:23:17.562481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:23:17.709784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-91e8f75b-7151-4f24-8c60-27a58ba7d724 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687749 Aug 17 11:23:17.709784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 159/309] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:23:17.723144 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ce953d1f-1eec-44fe-9c9b-5f0232df8b75 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:17.723824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ce953d1f-1eec-44fe-9c9b-5f0232df8b75 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:17.903508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ce953d1f-1eec-44fe-9c9b-5f0232df8b75 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:17.911071 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ce953d1f-1eec-44fe-9c9b-5f0232df8b75 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1214 microversion: 2.1 time: 0.192084 Aug 17 11:23:17.911712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 151/310] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:17 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:18.169089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:18.171447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:18.186826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.187463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.200625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.201678 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.206430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.208454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.253214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:18.261032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lazy-loading 'flavor' on Instance uuid aaec248d-889a-4d44-8bca-0de312ec1cb5 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:23:18.385480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9b3d9368-a10e-4fb5-b99b-8417064847cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/action" status: 200 len: 32 microversion: 2.1 time: 0.226746 Aug 17 11:23:18.388021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 160/311] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:23:18 2022] POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:23:18.404485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:18.406300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:18.417318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.418233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.419292 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.434308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.435059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.435524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.647588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:18.648347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:18.662186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.669653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.670348 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.671388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.672077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.672473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.720230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] HTTP exception thrown: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Request method failure captured: Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 HTTP/1.1 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M83QiWmVlJLpJPYLtCfOwpr8UnS4--LDF-SMqSpO4FDfpdA2M7ChlDGIvU2rbvC4McPs_R3yTzyGCwfquTQn31yO91078uVRr9ZP5CYK_J7Kzev_Q8egGAktQcU9We4kDWFyxQ3CbKvqUX67WcSU3tk4h_1tMt0O-b8Ba6l9uvvbss Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:18.722633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_489c5e5efcdb4ffbb51513e79efcb4a2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 5347450f8fe94a03b576b57597aaed82 Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.724017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '8e9ac9b7-5690-43b9-b995-eb854d25c009'} Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:18.724725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.725906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.727758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Returning 404 to user: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:18.734962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-35240eba-2c2a-4748-8cb7-bf165633dd01 tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 404 len: 111 microversion: 2.1 time: 0.093956 Aug 17 11:23:18.736796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 161/312] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:23:18 2022] DELETE /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:18.747848 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:18.748715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] [instance: 8e9ac9b7-5690-43b9-b995-eb854d25c009] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:18.756742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.757529 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.758114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.759201 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.759808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.760620 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.761794 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:18.800927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ac7bc1dd-31cb-431b-8f4d-f024fdcbbd45 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.403191 Aug 17 11:23:18.803019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 152/313] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:18 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:18.818090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] HTTP exception thrown: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Request method failure captured: Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 HTTP/1.1 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M83QiWmVlJLpJPYLtCfOwpr8UnS4--LDF-SMqSpO4FDfpdA2M7ChlDGIvU2rbvC4McPs_R3yTzyGCwfquTQn31yO91078uVRr9ZP5CYK_J7Kzev_Q8egGAktQcU9We4kDWFyxQ3CbKvqUX67WcSU3tk4h_1tMt0O-b8Ba6l9uvvbss Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:18.823794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/489c5e5efcdb4ffbb51513e79efcb4a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_489c5e5efcdb4ffbb51513e79efcb4a2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 489c5e5efcdb4ffbb51513e79efcb4a2 Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-DeleteServersTestJSON-1182520155 Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 5347450f8fe94a03b576b57597aaed82 Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-DeleteServersTestJSON-1182520155-project Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.828481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '8e9ac9b7-5690-43b9-b995-eb854d25c009'} Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:18.833685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. Aug 17 11:23:18.835204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:18.836421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] Returning 404 to user: Instance 8e9ac9b7-5690-43b9-b995-eb854d25c009 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:18.836421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-38753a29-f984-4742-bec5-2b0fb1a1dbdf tempest-DeleteServersTestJSON-1182520155 tempest-DeleteServersTestJSON-1182520155-project] 10.222.0.15 "GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009" status: 404 len: 111 microversion: 2.1 time: 0.086449 Aug 17 11:23:18.836421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 162/314] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:18 2022] GET /compute/v2.1/servers/8e9ac9b7-5690-43b9-b995-eb854d25c009 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:18.934575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:18.935404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:18.948606 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.950251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.950887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:18.953800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:18.955134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:18.956880 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:19.085516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:19.096380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4043f682-caf1-4dae-b95d-96cf40e1f352 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1218 microversion: 2.1 time: 0.163456 Aug 17 11:23:19.109580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 153/315] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:18 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:19.824565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:19.825937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:19.836941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:19.837713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:19.838313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:19.839191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:19.842035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:19.842683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:20.119695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:20.121112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:20.144028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:20.144635 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:20.145077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:20.151827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:20.158624 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:20.159647 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:20.522221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:20.537295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-988ab838-b915-4ffa-868a-be5b9100db0c tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1284 microversion: 2.1 time: 0.422957 Aug 17 11:23:20.552409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 154/316] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:20 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1284 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:20.652493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:20.666189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-316b3d25-44da-4125-a911-b561d53930a2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.845617 Aug 17 11:23:20.668039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 163/317] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:19 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:21.559451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:21.561323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:21.573193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:21.573713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:21.574355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:21.575250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:21.575892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:21.576484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:21.688204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:21.688846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:21.698046 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:21.698527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:21.704103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:21.705093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:21.705735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:21.706301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:21.808684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:21.816653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bc73c1e9-48ec-4edc-8a90-f6f23430c47f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1272 microversion: 2.1 time: 0.261131 Aug 17 11:23:21.834445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 155/318] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:21 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:22.057464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:22.069530 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-dc1d2be7-0853-4a81-8854-966ce3969479 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.382538 Aug 17 11:23:22.070338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 164/319] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:21 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:22.845124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:22.846716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:22.857904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:22.858916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:22.859710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:22.863248 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:22.863865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:22.865124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:23.095358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:23.097586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:23.114563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:23.115491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:23.116187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:23.118305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:23.122116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:23.124639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:23.658143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:23.666530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-53bedb5e-3174-4ff3-b789-d5a5f104e041 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.827297 Aug 17 11:23:23.667121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 156/320] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:22 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:23.695301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fd9204-4e0f-4160-92b4-42ff9f44e790", "tag": "f5737c72-7f70-4d93-ba0c-6441653270ca"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:23.740708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:23.741189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:23.741648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:23.822591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] Creating event network-changed:f5737c72-7f70-4d93-ba0c-6441653270ca for instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 on hv-cinder-85345 Aug 17 11:23:23.839655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-7c5fb316-8b72-4670-abfc-9b0910e60f2e req-79e614d2-ae8a-4222-bee2-79a272e68803 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171310 Aug 17 11:23:23.845710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 157/321] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:23.983709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:24.001021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-282d3ec4-2346-4c35-89d6-fd301cb892ba tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.906089 Aug 17 11:23:24.001705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 165/322] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:23 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:24.689734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:24.691619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:24.710963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:24.716626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:24.723493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:24.731348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:24.732355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:24.735792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:25.028702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:25.030399 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:25.044704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:25.045209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:25.054282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:25.058501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:25.073591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:25.076747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:25.447822 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:25.476193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-60103cee-c64b-4523-ade3-c3914c172158 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.792330 Aug 17 11:23:25.482911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 158/323] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:24 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:25.668965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:25.680656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-44200653-0488-44a2-a562-c74f290bc786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.659215 Aug 17 11:23:25.681552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 166/324] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:25 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:26.514988 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:26.517888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:26.521963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=62 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:26.554051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:26.555081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:26.560584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:26.565467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:26.567888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:26.568451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:26.707099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:26.707801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:26.715700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:26.716539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:26.721794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:26.722924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:26.723729 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:26.724359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:27.050750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:27.059053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4aed7499-0377-45d4-8369-efc93ee399ab tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.548383 Aug 17 11:23:27.059627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 159/325] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:26 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:27.440749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:27.528883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:27.565292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:27.575981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3a69936a-9c05-43ba-924f-d61522a5a741 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.876863 Aug 17 11:23:27.577154 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 167/326] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:26 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:28.081761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:28.082385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:28.091031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:28.099377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:28.099932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:28.100385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:28.101105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:28.101577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:28.102009 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:28.318642 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:28.328125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-03de0e7f-717d-4712-9565-35427db6e7bd tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.251925 Aug 17 11:23:28.341120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 160/327] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:28 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:28.596364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:28.597039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:28.606250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:28.609963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:28.611420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:28.612556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:28.614831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:28.615492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:28.911126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:28.931367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9c544aff-f487-41fc-97b2-597784c8ba4b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.335918 Aug 17 11:23:28.932245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 168/328] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:28 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:29.360023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:29.361322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:29.371196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:29.372159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:29.372811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:29.373945 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:29.374736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:29.375381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:29.744790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:29.775792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e523f647-6ab6-42a0-8f59-ec34e782b8be tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.419504 Aug 17 11:23:29.776366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 161/329] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:29 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:29.952448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:29.953164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:29.969142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:29.975079 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:29.976209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:29.977525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:29.979656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:29.983795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:30.317579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:30.329819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-16fb5550-cf3d-4e2e-99df-4795320eba79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.380726 Aug 17 11:23:30.335655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 169/330] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:29 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:30.468193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fd9204-4e0f-4160-92b4-42ff9f44e790", "name": "network-vif-plugged", "status": "completed", "tag": "f5737c72-7f70-4d93-ba0c-6441653270ca"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:30.496637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:30.497932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:30.502446 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:30.538776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] Creating event network-vif-plugged:f5737c72-7f70-4d93-ba0c-6441653270ca for instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 on hv-cinder-85345 Aug 17 11:23:30.549130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-a585b27e-273e-45a9-9959-85c8320301cb req-903b194a-14b1-4aa6-857d-eaf19a650824 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084759 Aug 17 11:23:30.549758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 162/331] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:30.799746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:30.800431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:30.815611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:30.818426 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:30.821648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:30.823471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:30.828375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:30.829737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:31.103570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:31.121139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-13960e2b-87dc-4863-a8df-8de86232182a tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.325939 Aug 17 11:23:31.123519 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 170/332] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:30 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:31.240356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-41d5d8de-24cf-4515-beab-0a3dbd56a6dd tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Action: 'create', calling method: .version_select at 0x7f9044464f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-145945344", "metadata": {"Type": "work"}}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-41d5d8de-24cf-4515-beab-0a3dbd56a6dd tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 121 Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:23:31.254006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-145945344", "metadata": {"Type": "work"}}} Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: Aug 17 11:23:31.255609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-145945344', 'metadata': {'Type': 'work'}}}} Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise error Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.256633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 11:23:31.258267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 11:23:31.259622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 11:23:31.259622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.261013 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-41d5d8de-24cf-4515-beab-0a3dbd56a6dd tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.262074 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-41d5d8de-24cf-4515-beab-0a3dbd56a6dd tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.235874 Aug 17 11:23:31.263077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 163/333] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 11:23:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:23:31.272010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-df40e5bc-aac0-440f-a2bf-44e3707f76fa tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Action: 'create', calling method: .version_select at 0x7f9044217ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2128531698", "metadata": {"Type": "work"}}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-df40e5bc-aac0-440f-a2bf-44e3707f76fa tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 120 Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:31.276859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2128531698", "metadata": {"Type": "work"}}} Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:23:31.278414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2128531698', 'metadata': {'Type': 'work'}}}} Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise error Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi '0' Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.279315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 11:23:31.280789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 11:23:31.282474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 11:23:31.282474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.282474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-df40e5bc-aac0-440f-a2bf-44e3707f76fa tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.282474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-df40e5bc-aac0-440f-a2bf-44e3707f76fa tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010252 Aug 17 11:23:31.282474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 171/334] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 11:23:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 11:23:31.288521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f1e9bc7c-3c0a-474e-b85a-92b7a1c80957 tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Action: 'create', calling method: .version_select at 0x7f9044227160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-933121383", "metadata": {"Type": "work"}}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f1e9bc7c-3c0a-474e-b85a-92b7a1c80957 tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 118 Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:23:31.292537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-933121383", "metadata": {"Type": "work"}}} Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: Aug 17 11:23:31.293922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-933121383', 'metadata': {'Type': 'work'}}}} Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise error Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi '' Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.294673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 11:23:31.296507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 11:23:31.299202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 11:23:31.299202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.299202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f1e9bc7c-3c0a-474e-b85a-92b7a1c80957 tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.299202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f1e9bc7c-3c0a-474e-b85a-92b7a1c80957 tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009930 Aug 17 11:23:31.299202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 164/335] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 11:23:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:23:31.306001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b57c3053-8cf3-4d21-9385-43867e86249d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Calling method '.version_select at 0x7f90443cab80>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:31.336567 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-b57c3053-8cf3-4d21-9385-43867e86249d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] HTTP exception thrown: Volume tempest-invalid-729748397 could not be found. Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b57c3053-8cf3-4d21-9385-43867e86249d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-729748397 HTTP/1.1 Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:31.338763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume tempest-invalid-729748397 could not be found. Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'tempest-invalid-729748397'} Aug 17 11:23:31.340435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-729748397 could not be found. (HTTP 404) (Request-ID: req-80dca4ac-2bf2-44fd-bf57-ba3c3ca7c523) Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.341410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:23:31.342757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-729748397 could not be found. Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:31.343806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-729748397 could not be found. Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-729748397 could not be found. Aug 17 11:23:31.344925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.346671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b57c3053-8cf3-4d21-9385-43867e86249d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 404 to user: Volume tempest-invalid-729748397 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.347591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b57c3053-8cf3-4d21-9385-43867e86249d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-729748397" status: 404 len: 98 microversion: 2.1 time: 0.046397 Aug 17 11:23:31.348355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 172/336] 10.222.0.15 () {58 vars in 1215 bytes} [Wed Aug 17 11:23:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-729748397 => generated 98 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 11:23:31.361127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:31.369858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:31.379419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9068b446-23de-4d0d-bd01-979f858c626b tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012872 Aug 17 11:23:31.380769 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:31.381438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:31.381573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 173/337] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 11:23:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 11:23:31.381959 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:31.382769 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:31.383223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:31.384979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:31.403978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-942678fb-6dbe-4690-8957-51e001a81cf4 tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007483 Aug 17 11:23:31.405476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 174/338] 10.222.0.15 () {58 vars in 1137 bytes} [Wed Aug 17 11:23:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 11:23:31.414967 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-863d81b1-9f10-4744-991a-c207e87d359d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Calling method '.version_select at 0x7f904434b820>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:31.446422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-863d81b1-9f10-4744-991a-c207e87d359d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] HTTP exception thrown: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-863d81b1-9f10-4744-991a-c207e87d359d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/os-volumes/e2b10f86-b8e3-439a-820c-f405ae07134f HTTP/1.1 Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:31.448641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'e2b10f86-b8e3-439a-820c-f405ae07134f'} Aug 17 11:23:31.449901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. (HTTP 404) (Request-ID: req-308e145c-ef7b-4ef5-8678-51d128929ee8) Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.450614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 11:23:31.451664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 11:23:31.453653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-863d81b1-9f10-4744-991a-c207e87d359d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 404 to user: Volume e2b10f86-b8e3-439a-820c-f405ae07134f could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-863d81b1-9f10-4744-991a-c207e87d359d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/e2b10f86-b8e3-439a-820c-f405ae07134f" status: 404 len: 109 microversion: 2.1 time: 0.039211 Aug 17 11:23:31.454739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 175/339] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:23:31 2022] DELETE /compute/v2.1/os-volumes/e2b10f86-b8e3-439a-820c-f405ae07134f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:31.461662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c39f1171-5675-42c2-945f-d5e6c1285f9d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Calling method '.version_select at 0x7f904434b310>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:31.510505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-c39f1171-5675-42c2-945f-d5e6c1285f9d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] HTTP exception thrown: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c39f1171-5675-42c2-945f-d5e6c1285f9d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Request method failure captured: Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/os-volumes/ab39e928-57d8-4077-bb67-4b46f5493571 HTTP/1.1 Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-y1_7Ea1gmWD2JbjIfKJkM2aPO_4UM70fFRmzlQTDNStRAm8XYsVY2ws1YxEyTA6GovQvr672sfZIRHUw5pi12OP6cHR7oLwKRPnRLG5juvLhALPKOF-zfpQm43JaJP7fZ0GrWc3vhp4oYROmde_8BJMzz99tsoPFk9HmD95GB0hA Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:31.512427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b5d7e1d811ea4a45a0c53d1f967c5f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b5d7e1d811ea4a45a0c53d1f967c5f0b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: b5d7e1d811ea4a45a0c53d1f967c5f0b Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesNegativeTest-563860007 Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 42f85dcfd3e743109acb6433fc2a49d6 Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesNegativeTest-563860007-project Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'ab39e928-57d8-4077-bb67-4b46f5493571'} Aug 17 11:23:31.513770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. (HTTP 404) (Request-ID: req-1a3dcabc-42d3-486e-b2f1-0bd872946a4b) Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.514518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 11:23:31.515576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 11:23:31.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c39f1171-5675-42c2-945f-d5e6c1285f9d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] Returning 404 to user: Volume ab39e928-57d8-4077-bb67-4b46f5493571 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c39f1171-5675-42c2-945f-d5e6c1285f9d tempest-VolumesNegativeTest-563860007 tempest-VolumesNegativeTest-563860007-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ab39e928-57d8-4077-bb67-4b46f5493571" status: 404 len: 109 microversion: 2.1 time: 0.057200 Aug 17 11:23:31.521489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 176/340] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 11:23:31 2022] GET /compute/v2.1/os-volumes/ab39e928-57d8-4077-bb67-4b46f5493571 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:31.660388 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:31.674465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9af8fcea-d28f-4a3f-b93f-560321505bcb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.317967 Aug 17 11:23:31.675244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 165/341] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:31 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:32.143047 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:32.144387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:32.154895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:32.155324 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:32.155752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:32.156460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:32.156905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:32.157323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:32.454693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:32.463950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-933605c4-5eb3-405a-9a73-311fcd0d635f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1314 microversion: 2.1 time: 0.324573 Aug 17 11:23:32.465251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 177/342] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:32 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:32.695898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:32.697139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:32.708958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:32.710052 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:32.710807 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:32.714458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:32.716043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:32.717089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:32.939595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:32.948747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-afecf0a8-7744-4767-ba48-2e1838f07863 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.257024 Aug 17 11:23:32.953002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 166/343] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:32 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:33.496420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:33.497045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:33.510409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:33.510901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:33.523757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:33.526014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:33.528176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:33.528615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:33.801237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:33.813724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b63821f6-015e-4412-bce3-d99a83a979ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1499 microversion: 2.1 time: 0.321035 Aug 17 11:23:33.828225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 178/344] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:33 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1499 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:33.975046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:33.975667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:33.982657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:33.983332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:33.983944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:33.984811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:33.985432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:33.986005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:34.013862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:34.541275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:34.546278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-23bb0041-5aca-4d03-9b99-5965b8a82ac2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.575440 Aug 17 11:23:34.546900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 167/345] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:33 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:34.608595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:34.609002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:34.617770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:34.618252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:34.618683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:34.619421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:34.619873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:34.620288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:34.673578 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:23:34.820306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-afe54126-6c6c-4e9a-abcf-e670f7e14416 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "DELETE /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 204 len: 0 microversion: 2.1 time: 0.215996 Aug 17 11:23:34.833017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 179/346] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:23:34 2022] DELETE /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:23:34.841491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:34.842124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:34.848885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:34.849373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:34.849835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:34.850540 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:34.851113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:34.851609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:35.213991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:35.226099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-47510114-b591-4d28-b4d4-9cd580e5788b tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1505 microversion: 2.1 time: 0.388222 Aug 17 11:23:35.227945 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 168/347] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:34 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:35.568029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:35.568669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:35.575240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:35.575587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:35.576198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:35.577072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:35.577895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:35.578547 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:35.800185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:35.804594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:35.812868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-828491be-5e7d-4472-8d34-dcc4ad72e25a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.249146 Aug 17 11:23:35.817834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 180/348] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:35 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:36.248120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:36.249360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:36.259086 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:36.263107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:36.263805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:36.264724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:36.265337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:36.265978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:36.474213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:36.496122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5192864e-6c7d-45b1-8f67-b384716c582f tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1505 microversion: 2.1 time: 0.247396 Aug 17 11:23:36.498772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 169/349] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:36 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:36.835888 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:36.836589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:36.857780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:36.858317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:36.859919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:36.861838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:36.862624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:36.863382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:37.034113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:37.043221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d5cf692c-41ec-4197-8af1-34aaa234057b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.213059 Aug 17 11:23:37.057347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 181/350] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:36 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:37.350797 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fd9204-4e0f-4160-92b4-42ff9f44e790", "name": "network-vif-deleted", "tag": "f5737c72-7f70-4d93-ba0c-6441653270ca"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:37.361035 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:37.361546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:37.361983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:37.373673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] Creating event network-vif-deleted:f5737c72-7f70-4d93-ba0c-6441653270ca for instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 on hv-cinder-85345 Aug 17 11:23:37.385268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-85424228-0e62-43e9-ae2b-ddef69fb0373 req-e96bc1f3-d4bf-4cb1-922a-67e88c7660cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Aug 17 11:23:37.386206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 170/351] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:37.521025 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:37.521914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:37.540793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:37.541394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:37.542217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:37.543132 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:37.543651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:37.544136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:37.583803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:37.584369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:37.585038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:37.585666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lazy-loading 'fault' on Instance uuid 41fd9204-4e0f-4160-92b4-42ff9f44e790 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:23:37.652906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f6fcee54dc4c2e82c340a3e7615dda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6406e8acf64333a2e0c46e556fb8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:37.661693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-31e9b4b1-3ac2-4987-912b-945b34f42ae7 tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 200 len: 1304 microversion: 2.1 time: 0.144649 Aug 17 11:23:37.668805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 182/352] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:37 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:38.083312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:38.084391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:38.092156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:38.092946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:38.093392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:38.094536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:38.095169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:38.095779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:38.392222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:38.402495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4afaf7da-db1c-41bb-a503-aa82748f7055 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.341720 Aug 17 11:23:38.404419 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 171/353] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:38 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:38.682338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:38.683676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] [instance: 41fd9204-4e0f-4160-92b4-42ff9f44e790] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:38.689988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:38.690714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:38.691227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:38.692172 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:38.692826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:38.693461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] HTTP exception thrown: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Request method failure captured: Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 HTTP/1.1 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M9YhTBW8Y9BS7RFEBSar60y7UfSWyZolyAl34a96XkiR2GNNf1kwnEVNEkBrRgvmhTW07qPp4s64i7UBVNIn8JX9E44SknCE8-k8FLTWmlCFssAHUbchWZxKJQnwSLHg2Xs76C_FPUm0XiyqYyhNu0HHumhM72i9zjl3imdss3ZfJo Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 2e6406e8acf64333a2e0c46e556fb8b7 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:23:38.716343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2e6406e8acf64333a2e0c46e556fb8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2e6406e8acf64333a2e0c46e556fb8b7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 2e6406e8acf64333a2e0c46e556fb8b7 Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesActionsTest-1761505044 Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesActionsTest-1761505044-project Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 62f6fcee54dc4c2e82c340a3e7615dda Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesActionsTest-1761505044-project Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. Aug 17 11:23:38.717741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '41fd9204-4e0f-4160-92b4-42ff9f44e790'} Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:38.718449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. Aug 17 11:23:38.720115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:23:38.721281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] Returning 404 to user: Instance 41fd9204-4e0f-4160-92b4-42ff9f44e790 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:38.721281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-063cf542-37bf-4124-91ce-add3d35e69ac tempest-VolumesActionsTest-1761505044 tempest-VolumesActionsTest-1761505044-project] 10.222.0.15 "GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790" status: 404 len: 111 microversion: 2.1 time: 0.032586 Aug 17 11:23:38.721281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 183/354] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:38 2022] GET /compute/v2.1/servers/41fd9204-4e0f-4160-92b4-42ff9f44e790 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:39.001911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4289fe88-c3e4-4d3e-8155-fd440445120a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'create', calling method: .version_select at 0x7f90443bd0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1978109791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNF4+xM6x+fup09cjD5mPjqFTCjXgtUFhKrtyQNVM55HgxRmfHQPqtQxycskTloUdxlhmHxQEj2VupBX2Zle23gs6PkZCbLt3zRDtJRGTZpsi1jhO5rSgD/a4bxngLxVw=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:39.030958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-4289fe88-c3e4-4d3e-8155-fd440445120a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Getting quotas for project 094318249c064c24a6caa73e916ed6eb. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:23:39.035531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-4289fe88-c3e4-4d3e-8155-fd440445120a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Getting quotas for user c8952da31e954c839be8ec8f6cd548a0 and project 094318249c064c24a6caa73e916ed6eb. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:23:39.063884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4289fe88-c3e4-4d3e-8155-fd440445120a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.066954 Aug 17 11:23:39.064608 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 172/355] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:23:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:39.164244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-399268199", "imageRef": "d6fec254-59af-4a68-b15e-25e92bf7f936", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1978109791", "networks": [{"uuid": "aedc833d-a74c-46cf-94bc-c360c3a60ad2"}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:39.217709 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] validate_networks() for [('aedc833d-a74c-46cf-94bc-c360c3a60ad2', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:23:39.427456 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:39.428757 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:39.436069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:39.437205 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:39.437766 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:39.438535 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:39.439060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:39.439547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:39.681089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:39.695861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4479557c-d8a3-483c-8e93-6cc4816821be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.273273 Aug 17 11:23:39.696601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 173/356] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:39 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:39.718173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:23:39.718720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:23:39.719163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:23:39.719630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:23:39.720119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:23:39.730060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:39.730633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:39.731120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:39.731847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:39.732375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:39.732684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:39.750009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Getting quotas for project 094318249c064c24a6caa73e916ed6eb. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:23:39.759757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Getting quotas for user c8952da31e954c839be8ec8f6cd548a0 and project 094318249c064c24a6caa73e916ed6eb. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:23:39.772116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:23:39.774492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6fec254-59af-4a68-b15e-25e92bf7f936',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:23:39.827506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0c24e9db-bc96-4e97-9bea-d7df85183774 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667230 Aug 17 11:23:39.828248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 184/357] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:23:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:23:39.842832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d1290a83-2d2f-440a-bb86-e81893b712f4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:39.843441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d1290a83-2d2f-440a-bb86-e81893b712f4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:39.896555 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1290a83-2d2f-440a-bb86-e81893b712f4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:39.903345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d1290a83-2d2f-440a-bb86-e81893b712f4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1258 microversion: 2.1 time: 0.064396 Aug 17 11:23:39.903897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 174/358] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:39 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:40.716167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:40.716803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:40.723737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:40.724323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:40.724792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:40.725478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:40.725953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:40.726581 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:40.874195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:40.881712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d45dd99d-afc1-4955-aaf3-81ca3149089c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.169395 Aug 17 11:23:40.895589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 185/359] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:40 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:40.925183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:40.926084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:40.932895 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:40.933700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:40.934137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:40.934986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:40.935598 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:40.936588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:41.011668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:41.021646 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-73370a81-c9db-420a-b2dd-f1cdd2b83d8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.100217 Aug 17 11:23:41.022203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 175/360] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:40 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:41.902905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:41.903511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:41.909814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:41.910291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:41.910809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:41.911481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:41.911907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:41.912321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:42.043308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:42.046781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:42.047252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:42.053804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:42.054378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:42.054871 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:42.055626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:42.056292 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:42.056858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:42.060546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2f01e6c9-46df-4441-b01c-1a45ccbcae0e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.161457 Aug 17 11:23:42.061381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 186/361] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:41 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:42.122255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:42.129916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7f72cea8-4cf9-4b01-94da-98296932f1e1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.091167 Aug 17 11:23:42.130474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 176/362] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:42 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:43.081329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:43.081941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:43.089146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:43.089651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:43.090075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:43.090754 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:43.091203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:43.091611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:43.150708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:43.151323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:43.157909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:43.158584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:43.159009 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:43.159889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:43.160344 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:43.160789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:43.224714 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:43.232664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d93ee4de-7355-4fd6-8c92-32dff0f1cb33 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.086021 Aug 17 11:23:43.233506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 177/363] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:43 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:43.246138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:43.255403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ff9f2d8a-168d-4a4a-bbf1-c451fcaa9c94 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.177947 Aug 17 11:23:43.255931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 187/364] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:43 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:44.253752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:44.254332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:44.261160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:44.261690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:44.262128 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:44.263017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:44.263477 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:44.263901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:44.279190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:44.279914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:44.286108 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:44.286646 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:44.287066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:44.287747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:44.288198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:44.288599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:44.335675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:44.343160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-790f3be9-435e-4a01-a392-baa7c4666623 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.093390 Aug 17 11:23:44.343701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 178/365] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:44 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:44.428991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:44.440413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9b6638dc-7f44-4038-b99d-896ff25b43f2 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.164874 Aug 17 11:23:44.441212 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 188/366] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:44 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:45.368095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:45.369293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:45.380119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:45.380915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:45.381704 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:45.382839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:45.383601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:45.384343 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:45.449451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:45.457258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-11032bd5-941d-4194-85fe-f226527bd1c2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.095705 Aug 17 11:23:45.457889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 179/367] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:45 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:45.461861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:45.462463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:45.464330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:45.470287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:45.470770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:45.471147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:45.471856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:45.472301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:45.472711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:45.606078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:45.613823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bdfde33d-8de1-4843-bdcc-bfd2a1097ddb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.155918 Aug 17 11:23:45.614416 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 189/368] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:45 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:46.479455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:46.480088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:46.487294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:46.487803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:46.488250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:46.488968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:46.489456 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:46.489932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:46.551638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:46.559425 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0f977923-1b9f-4ad3-a7d5-606c74223f02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.084068 Aug 17 11:23:46.559986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 180/369] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:46 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:46.636320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:46.637091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:46.645477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:46.646266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:46.646855 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:46.647772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:46.648425 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:46.648982 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:46.783062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:46.792048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f3e6aa8c-16b9-490a-a994-ed7f03daf9d8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.160907 Aug 17 11:23:46.792943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 190/370] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:46 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:47.584281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:47.584913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:47.592368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:47.592914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:47.593401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:47.594223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:47.594729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:47.595202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:47.661247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:47.668775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-54d3bf7d-9718-4af2-9d2a-1f09b8f26615 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.091030 Aug 17 11:23:47.669333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 181/371] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:47 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:47.816885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:47.817857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:47.824577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:47.825056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:47.825551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:47.826241 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:47.826693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:47.827108 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:47.962689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:47.970302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d5011d6c-e1c1-431a-8ca4-deba8c4f24d6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.159927 Aug 17 11:23:47.970862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 191/372] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:47 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:48.693699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:48.694401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:48.704007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:48.704654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:48.705319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:48.706345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:48.707056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:48.707546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:48.774925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:48.783167 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9157f604-edf4-420f-b395-8152a3652799 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1262 microversion: 2.1 time: 0.095445 Aug 17 11:23:48.783713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 182/373] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:48 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:48.993636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:48.994211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:49.000790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:49.001297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:49.001783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:49.002501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:49.003009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:49.003516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:49.143063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:49.150678 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9982ed1c-04c6-4818-ac7e-fbeaebbc501d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.162108 Aug 17 11:23:49.151259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 192/374] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:48 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:49.807237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:49.807815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:49.814507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:49.814986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:49.815414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:49.816096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:49.816544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:49.816969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:49.889043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:49.897018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2d52a035-c403-4c50-b5e1-f31b5d731b8a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1310 microversion: 2.1 time: 0.094129 Aug 17 11:23:49.897616 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 183/375] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:49 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:50.178475 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:50.179127 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:50.181000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:50.181725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:50.187454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:50.187928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:50.188356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:50.189026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:50.189570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:50.190012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:50.337396 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:50.346556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1548192a-00d2-4733-ab21-f2b12c078664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.172016 Aug 17 11:23:50.347181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 193/376] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:50 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:50.918157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:50.919095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:50.927213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:50.943180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:50.943991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:50.944612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:50.945803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:50.946408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:50.946979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:51.035574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:51.045458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c43e24e5-f3f5-4e3b-9d3b-8f498def2377 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1310 microversion: 2.1 time: 0.131238 Aug 17 11:23:51.048066 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 184/377] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:50 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:51.373941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:51.379568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:51.398130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:51.398910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:51.402968 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:51.411534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:51.413306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:51.414972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:51.822039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:51.832403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f0c951ac-4a17-4968-b744-f99badfd6772 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.467640 Aug 17 11:23:51.833246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 194/378] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:51 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:52.068126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:52.069391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:52.078695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:52.079181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:52.079738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:52.080505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:52.081100 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:52.081547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:52.296749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:52.319066 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6d733162-ebfa-463a-85bc-10dedb51330d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1316 microversion: 2.1 time: 0.252185 Aug 17 11:23:52.336634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 185/379] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:52 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:52.858657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:52.859301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:52.869156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:52.869689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:52.870118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:52.871248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:52.871704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:52.872122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.124843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:53.139651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-044fc3de-e617-4e55-85e9-40d62c9981f3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1502 microversion: 2.1 time: 0.284197 Aug 17 11:23:53.154340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 195/380] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:52 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:53.166111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4119e71c-a552-4dbf-8756-331133dc6d54"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:53.172256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:53.181255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.182109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.182873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.183982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.184865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.185627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.216270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] HTTP exception thrown: Cannot 'attach_volume' instance aaec248d-889a-4d44-8bca-0de312ec1cb5 while it is in vm_state rescued Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Request method failure captured: Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/os-volume_attachments HTTP/1.1 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 74 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M8xQsP11rqoHSeqYadoRVeDEYhp-4efQLBtYZ9ExNFk7m0a63FVlWNxjOovefVWXJCcfgx7dmg8VkIZPNKffCwErdnV6CxJIx2SVb6bGfPUP5ckg8D2etpmBFaTnuAdFGJ_9g-sJoNGDR5WPjEkaxTAahOxiWBxfx2fE6RaOSQZwJI Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:23:53.218379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56b9f381040f4998bfaf4fc07a995380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: b5b61f023e1a403da575d83027e777ee Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {"volumeAttachment": {"volumeId": "4119e71c-a552-4dbf-8756-331133dc6d54"}} Aug 17 11:23:53.219744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Cannot 'attach_volume' instance aaec248d-889a-4d44-8bca-0de312ec1cb5 while it is in vm_state rescued Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'server_id': 'aaec248d-889a-4d44-8bca-0de312ec1cb5', 'body': {'volumeAttachment': {'volumeId': '4119e71c-a552-4dbf-8756-331133dc6d54'}}} Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:23:53.220507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aaec248d-889a-4d44-8bca-0de312ec1cb5 while it is in vm_state rescued Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:23:53.222516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:23:53.223601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:23:53.223601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:23:53.223601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aaec248d-889a-4d44-8bca-0de312ec1cb5 while it is in vm_state rescued Aug 17 11:23:53.223601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:23:53.224913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Returning 409 to user: Cannot 'attach_volume' instance aaec248d-889a-4d44-8bca-0de312ec1cb5 while it is in vm_state rescued {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:23:53.226371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8a87e743-9ed3-40b0-9f2e-8410a642faef tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067652 Aug 17 11:23:53.236861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:53.237547 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:53.242457 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 186/381] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:23:53 2022] POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 17 11:23:53.247461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.248051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.248883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.249937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.250595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.251250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.341949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8b3aac95-b138-4bf5-ba03-871a4b4ed78e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/action" status: 202 len: 0 microversion: 2.1 time: 0.109036 Aug 17 11:23:53.347594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:53.348659 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:53.352543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 196/382] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:23:53 2022] POST /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:23:53.362100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:53.363709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.364219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.364641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.365521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.365938 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.372002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:53.374718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.387400 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:53.390393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.390913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.394787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.395589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:53.396075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:53.396521 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:53.455021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:54.030284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:54.050406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-08cb4a35-77d3-4d9f-99a9-ef1404d48e6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.692476 Aug 17 11:23:54.051991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:54.064926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 197/383] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:53 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:54.074268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bec30d1d-99a6-49dc-9df9-9b13e41c3dbb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.730359 Aug 17 11:23:54.075263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 187/384] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:53 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:54.608533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:23:54.639384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:54.640581 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:54.641224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:54.687713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] Creating event network-changed:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:23:54.707383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-e83ed0c8-2786-429f-9d8a-ec653620e8cf req-eab84e3e-eb65-48a3-9f7c-ab8b569075d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103088 Aug 17 11:23:54.711656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 198/385] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:23:55.074342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:55.075822 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:55.084592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:55.085619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:55.086589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:55.088677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:55.089386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:55.090236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:55.111271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:55.115367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:55.134704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:55.141691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:55.149413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:55.150715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:55.159294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:55.160259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:55.710834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:55.718300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:55.729538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6ce7ba24-7997-465e-b15d-c538852d3fb5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.659822 Aug 17 11:23:55.730819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 188/386] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:55 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:55.740277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-26fb00ed-4453-4cd6-ae69-791d94fbc24d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.634454 Aug 17 11:23:55.741186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 199/387] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:55 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:56.764085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:56.765374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:56.765868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:56.766600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:56.776659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:56.779586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:56.779928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:56.780380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:56.781093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:56.781721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:56.782271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:56.783908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:56.784599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:56.785243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:56.786177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:56.786824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:56.787498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:57.053876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:57.062679 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6f46e28e-a818-4329-87ad-43f829b14982 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.301152 Aug 17 11:23:57.072056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 200/388] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:56 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:23:57.117348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:57.140978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-44531d88-aa05-4542-9b34-6219fbb3b177 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.380176 Aug 17 11:23:57.151374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 189/389] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:56 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:58.098250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:58.099726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:58.106407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:58.107302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:58.108631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:58.110013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:58.110972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:58.111608 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:58.164725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:58.166062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:58.178824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:58.179665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:58.181500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:58.184365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:58.185101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:58.185824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:58.512655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:58.525825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a6e5cf61-09fb-4144-a134-6b15c0011091 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.361310 Aug 17 11:23:58.526444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 190/390] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:58 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:58.540516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:58.556597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ed8e6270-2859-49d9-b93c-1afd75a714a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.462927 Aug 17 11:23:58.570829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 201/391] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:58 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:59.548049 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:59.548667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:59.555724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:59.556218 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:59.556648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:59.557384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:59.557884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:59.558302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:59.580258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:23:59.581746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:23:59.598909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:59.599438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:59.599867 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:59.600577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:23:59.601021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:23:59.604018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:23:59.751190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:59.759658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9c42f15a-2498-46b5-909b-131c4ad524b1 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.215413 Aug 17 11:23:59.760214 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 191/392] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:59 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:23:59.790660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:23:59.798820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8388f9f2-aac2-4144-9379-d7ee5b40e0ec tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.222916 Aug 17 11:23:59.799393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 202/393] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:23:59 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:00.780587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:00.798285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:00.811168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:00.812473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:00.814023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:00.815729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:00.816264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:00.818859 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:00.819988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:00.820914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:00.831891 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:00.834036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:00.834656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:00.836442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:00.837652 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:00.838246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:01.073956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:01.077021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:01.093233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b865a46c-4c2f-423f-acaa-9442cbc7c296 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.277071 Aug 17 11:24:01.095298 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3f4f355c-99ce-4675-8249-7fe110f972b9 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.318576 Aug 17 11:24:01.099323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 203/394] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:00 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:01.102355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 192/395] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:00 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:02.123149 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:02.124761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:02.128857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:02.129501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:02.133097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:02.133818 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:02.134436 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:02.135757 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:02.136580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:02.137188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:02.139626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:02.140121 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:02.140564 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:02.141275 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:02.141756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:02.142182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:02.348632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:02.358481 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b178cce4-527b-4c55-a547-6d7a51f5fcc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.239507 Aug 17 11:24:02.373094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 193/396] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:02 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:02.406550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:02.414379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1a6efcd9-9517-4053-ac9c-97de1a251e68 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.297003 Aug 17 11:24:02.414951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 204/397] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:02 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:03.379137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:03.379722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:03.386357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:03.386836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:03.387275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:03.388086 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:03.388543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:03.388966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:03.435059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:03.435662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:03.441934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:03.442410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:03.442831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:03.443730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:03.445011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:03.445811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:03.574261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:03.585666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-42a1225c-d38f-4eab-8775-b8e93ebca1e0 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.210014 Aug 17 11:24:03.586920 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 194/398] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:03 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:03.631061 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:03.638636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d7e93170-ead6-4b29-86bd-49ae5e3647cd tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.207569 Aug 17 11:24:03.639197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 205/399] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:03 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:04.607491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:04.608118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:04.622409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:04.622948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:04.623612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:04.624542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:04.625947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:04.626593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:04.659707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:04.660327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:04.674241 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:04.674726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:04.675150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:04.675853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:04.676298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:04.676706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:04.906289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:04.912567 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:04.932418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-db3fb080-b363-44bd-9c2a-cc2953c1c23e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.312363 Aug 17 11:24:04.932418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 195/400] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:04 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:04.958096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-10f34b88-46b1-46a8-bb55-2e98c2ab46c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.302270 Aug 17 11:24:04.958730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 206/401] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:04 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:05.947361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:05.948883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:05.962739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:05.963550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:05.964561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:05.965558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:05.967449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:05.968243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:05.980551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:05.982007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:05.994766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:05.995584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:05.996435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:05.998334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:06.003445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:06.004124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:06.290667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:06.311366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-27db77ce-50e0-4d31-a3f2-aef7bef31059 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.370316 Aug 17 11:24:06.322278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 196/402] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:05 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:06.365962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:06.394576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d4b75a9e-b620-4ca7-ac2c-0029e0982a73 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.417929 Aug 17 11:24:06.397538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 207/403] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:05 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:06.781527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-534086574", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "networks": [{"uuid": "4157a166-7d50-4b25-a72f-e9c8380b2d40"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:07.336881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:07.337522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:07.346572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:07.347476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:07.351088 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:07.353469 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:07.354422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:07.355274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:07.657975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:07.670426 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-64823943-a3f6-4f3c-81fe-dd9dafd3cbad tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.336875 Aug 17 11:24:07.684674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 208/404] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:07 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:07.690437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:07.691055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:07.700150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:07.700645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:07.701288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:07.704653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:07.704653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:07.704653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:07.869466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:07.879586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5e2fd11a-b5a8-48e0-a243-9b64cbdfda6d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.192962 Aug 17 11:24:07.893496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 209/405] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:07 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:08.707167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:08.708058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:08.725179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:08.725179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:08.725179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:08.725179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:08.725699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:08.725699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:09.015911 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:09.023714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-024cf0b9-b299-427c-a7fb-b626deb67aee tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.320725 Aug 17 11:24:09.039112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 210/406] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:08 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:09.047485 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:09.052210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:09.070869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:09.071647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:09.072217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:09.073083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:09.073741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:09.074362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:09.473949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:09.482247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9a2b6d9b-6d89-4efb-a6eb-d7084b1e2793 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.441787 Aug 17 11:24:09.485897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 211/407] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:09 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:10.050672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:10.051957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:10.061339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:10.064685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:10.066757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:10.068685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:10.074247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:10.074911 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:10.412018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:10.422260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0f40b490-d2eb-4138-b4f7-6cbaac7f0e8c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.375491 Aug 17 11:24:10.454674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 212/408] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:10 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:10.514401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:10.516055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:10.536539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:10.537247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:10.540535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:10.551325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:10.563427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:10.565477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:10.602891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] validate_networks() for [('4157a166-7d50-4b25-a72f-e9c8380b2d40', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:24:11.097040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:11.110183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-84486051-c345-4dc5-8b10-00877280570d tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1510 microversion: 2.1 time: 0.599853 Aug 17 11:24:11.111472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 213/409] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:10 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:11.388034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:24:11.388455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:24:11.388971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:24:11.389317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:24:11.389904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:24:11.415874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:11.416949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:11.417687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:11.431796 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:11.437577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:11.440582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:11.444696 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:11.445952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:11.455077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:11.455923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:11.457852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:11.459268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:11.459897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:11.460647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:11.481497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Getting quotas for project 98b5f72e13f24093afcbafe833bd4324. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:24:11.486020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Getting quotas for user c8479873dd8a4a84a27dcd976a35f943 and project 98b5f72e13f24093afcbafe833bd4324. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:24:11.502974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:24:11.505790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:24:11.594622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9f4f2cd7-d57f-4bce-a014-7d443003ea1c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.814763 Aug 17 11:24:11.596164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 197/410] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:24:11.615318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4433d4e4-68ba-4140-aef9-10a87dce200a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:11.622348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4433d4e4-68ba-4140-aef9-10a87dce200a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:11.719626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4433d4e4-68ba-4140-aef9-10a87dce200a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:11.730255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4433d4e4-68ba-4140-aef9-10a87dce200a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1218 microversion: 2.1 time: 0.125650 Aug 17 11:24:11.732255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 198/411] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:11 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:11.751170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:11.755314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:11.761794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6d2c5395-e62b-4d99-af60-d02c958842fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.321451 Aug 17 11:24:11.763085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 214/412] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:11 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:12.133550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:12.134055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:12.158916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.160486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.160933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:12.161744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.167251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.167977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:12.449980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:12.464706 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-628a5081-0e0b-4874-bb83-823143d09888 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1516 microversion: 2.1 time: 0.336172 Aug 17 11:24:12.465909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 199/413] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:12 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:12.763558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:12.764112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:12.787035 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:12.787932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:12.798800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.799322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.805735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:12.812007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.817268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.819409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.820435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:12.823120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.825353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:12.830070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:12.839940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:12.841878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:13.260232 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:13.272749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b7d4f89b-052a-4dc3-beb2-a7d13ec7b421 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.490519 Aug 17 11:24:13.288776 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:13.304916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 200/414] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:12 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:13.306868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d7f84224-eed0-40d4-9478-4442ba147b73 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1222 microversion: 2.1 time: 0.547648 Aug 17 11:24:13.309890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 215/415] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:12 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1222 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:14.303091 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:14.304548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:14.318939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:14.321719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:14.324231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:14.325865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:14.327358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:14.328211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:14.342045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:14.344191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:14.373588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:14.375158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:14.376303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:14.377761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:14.378623 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:14.379418 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:14.590862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:14.601866 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bf6da6ec-6f5f-49bd-8b38-db96429aef96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1270 microversion: 2.1 time: 0.269392 Aug 17 11:24:14.604155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 216/416] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:14 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:14.687007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:14.701351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a5e4e48f-a13f-4f26-a51e-2b18a8b18b3d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.403442 Aug 17 11:24:14.705894 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 201/417] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:14 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:15.193931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7b81b5b9-04fa-4842-a377-1d93eb3940bb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: .version_select at 0x7f9044217430>, body: {"keypair": {"name": "tempest-keypair-1345759564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv6LST75T1dEJxmCQJsYoM1iRuwtpt440xrM9V/TSj5uh7OGBjYvJyPH1keJs4QsdLzsiVZzaBrOf8463MEXiMoeMVn3ejoW0x31v/b27EYpPQvCv5j8cHOaLtRlB8g7A=="}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:15.234379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-7b81b5b9-04fa-4842-a377-1d93eb3940bb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for project 56b9f381040f4998bfaf4fc07a995380. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:24:15.240357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-7b81b5b9-04fa-4842-a377-1d93eb3940bb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for user b5b61f023e1a403da575d83027e777ee and project 56b9f381040f4998bfaf4fc07a995380. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:24:15.280861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7b81b5b9-04fa-4842-a377-1d93eb3940bb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090760 Aug 17 11:24:15.288612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 217/418] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:24:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:15.626339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:15.628059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:15.645279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:15.647212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:15.648209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:15.650040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:15.652402 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:15.653744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:15.723237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:15.725453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:15.732713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:15.736769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:15.739407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:15.740934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:15.744473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:15.747292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:15.747964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:15.908979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:15.923199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e7045c35-58cc-4a73-8137-e04c3c9d0ac5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1270 microversion: 2.1 time: 0.303060 Aug 17 11:24:15.923795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 202/419] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:15 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:16.144175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:16.223091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-20ea3214-0e62-43f5-b181-cde8ca454497 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.501827 Aug 17 11:24:16.227680 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 218/420] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:15 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:16.947087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:16.947814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:16.958385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:16.962891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:16.963604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:16.965388 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:16.966347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:16.966981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:17.129201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:17.142583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d29b2fad-baa1-4ff3-98d4-d014afab093d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1270 microversion: 2.1 time: 0.199564 Aug 17 11:24:17.156435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 203/421] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:16 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:17.248038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:17.248965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:17.255559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:17.256052 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:17.264251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:17.265293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:17.265887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:17.269131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:17.476611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:17.485586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9ec5b541-fa5f-43a6-a644-cfe4001d6f1f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.241505 Aug 17 11:24:17.489961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 219/422] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:17 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:18.085443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-266421440", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e0c78bc-2ba7-4ce5-80e0-43b85d3aa9c8"}], "security_groups": [{"name": "tempest-securitygroup--2053822252"}], "key_name": "tempest-keypair-1345759564", "user_data": "}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:18.163816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:18.164512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:18.174737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:18.177682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:18.178319 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:18.179203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:18.181464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:18.182249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:18.418639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:18.437549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-21166b3c-2d30-4df0-8ee5-593a59ae7c85 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1276 microversion: 2.1 time: 0.275056 Aug 17 11:24:18.456649 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 220/423] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:18 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:18.463727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] validate_networks() for [('5e0c78bc-2ba7-4ce5-80e0-43b85d3aa9c8', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:24:18.522746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:18.525123 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:18.540766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:18.543089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:18.543735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:18.545508 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:18.546183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:18.546786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:19.066562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:19.084057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fb8c1d0d-d2ed-499e-a31b-83ff98658fc5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.581111 Aug 17 11:24:19.089632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 221/424] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:18 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:19.473704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:19.475703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:19.499442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:19.507069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:19.507839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:19.508628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:19.509086 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:19.509764 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:19.739778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:24:19.740840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:24:19.742110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:24:19.742719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:24:19.743532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:24:19.770760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:19.773635 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:19.775794 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:19.779805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:19.781510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:19.784551 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:19.855446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:19.860190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:24:19.869631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-31526022-b7ef-4e4c-90a1-aba7a52ee755 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.395442 Aug 17 11:24:19.871948 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 222/425] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:19 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:19.877962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Getting quotas for user b5b61f023e1a403da575d83027e777ee and project 56b9f381040f4998bfaf4fc07a995380. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:24:19.907711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:24:19.913510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:24:19.997882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "name": "network-vif-plugged", "status": "completed", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:20.053753 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:20.054554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:20.055526 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-dcc484ec-8de2-4d40-b473-dc6b67e05e99 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.974558 Aug 17 11:24:20.056625 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 204/426] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:24:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 1977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:24:20.057102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:20.071246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8f0731c6-7afe-4ce2-9cfb-f5cb6b8cb769 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:20.075066 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8f0731c6-7afe-4ce2-9cfb-f5cb6b8cb769 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:20.090574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] Creating event network-vif-plugged:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:24:20.111666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-206a82a7-7675-4e64-aabf-88e5abdfd28b req-00a4d5e4-3b85-46b2-9389-2c822ed18744 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136611 Aug 17 11:24:20.115587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 223/427] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:20.132072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:20.133019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:20.148758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:20.149689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:20.150786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:20.152537 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:20.153963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:20.156789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:20.527361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8f0731c6-7afe-4ce2-9cfb-f5cb6b8cb769 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:20.534965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8f0731c6-7afe-4ce2-9cfb-f5cb6b8cb769 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1245 microversion: 2.1 time: 0.471704 Aug 17 11:24:20.535571 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 205/428] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:20 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1245 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:20.897568 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:20.898058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:20.908778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:20.909731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:20.910176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:20.911101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:20.911623 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:20.915564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:21.219352 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:21.231748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-33f79d87-2bfc-4546-90f3-b3171bc14ed6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 1.112339 Aug 17 11:24:21.232663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 224/429] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:20 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:21.395007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4", "tag": "4e8eeb5c-c626-4304-a2e4-c55bcee1bed8"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:21.417492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:21.420954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:21.421413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:21.442031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:21.459493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fb9cb7ff-71e4-439b-9aa1-1691223985c4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.563613 Aug 17 11:24:21.460661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 206/430] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:20 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:21.467308 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] Creating event network-changed:4e8eeb5c-c626-4304-a2e4-c55bcee1bed8 for instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 on hv-cinder-85345 Aug 17 11:24:21.483027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-c16007fd-7ef3-4c87-b996-7a705f936ecf req-5ce7bafe-3116-420f-95dd-bbf326b06750 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087385 Aug 17 11:24:21.484025 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 225/431] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:21.560613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:21.562254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:21.585177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:21.585986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:21.586641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:21.596824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:21.598266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:21.600587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:21.606971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:21.732357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:21.747586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3d1df29a-474d-4d5d-a415-52cc5a19b83b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1241 microversion: 2.1 time: 0.193740 Aug 17 11:24:21.748133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 207/432] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:21 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:22.257563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:22.258793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:22.266252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.266748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.267254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:22.268123 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.269048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.269706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:22.482500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:22.483139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:22.491805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.492327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.492767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:22.493734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.494181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.494604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:22.832312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:22.840553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f43444ee-8d33-44e8-8141-1f1406f274cd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.362077 Aug 17 11:24:22.844239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 208/433] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:22 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:22.850100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:22.855691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:22.856342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:22.874304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.874808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.875301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-76b7a72e-336f-471b-ab6a-986de14b7f1c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1358 microversion: 2.1 time: 0.625577 Aug 17 11:24:22.876736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:22.877488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:22.878112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:22.878249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 226/434] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:22 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1358 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:22.878819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:23.022827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:23.033183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e6679eb1-e771-4513-bf7d-b193a5414664 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1297 microversion: 2.1 time: 0.187779 Aug 17 11:24:23.034382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 209/435] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:22 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1297 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:23.870649 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:23.871269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:23.879251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:23.879740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:23.880239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:23.880945 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:23.881616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:23.882133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:23.900338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:23.908056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:23.923727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:23.924231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:23.924663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:23.925611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:23.926219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:23.926823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.179831 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.190022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2fcfd958-4c3c-41e3-a86c-4300c32cbcf3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1548 microversion: 2.1 time: 0.293417 Aug 17 11:24:24.190837 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 210/436] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:23 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1548 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:24.195937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.204348 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-255c4176-b02d-4f24-a4bc-c1b9299a19f2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.341724 Aug 17 11:24:24.205035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 227/437] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:23 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:24.227099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:24.233747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:24.234373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:24.239715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:24.241366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.241898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.242339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.243051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.243507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.243935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.245883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.246362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.247387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.248240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.248843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.249410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.339899 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.368797 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4b6436d0-c3d8-45e7-9414-806226d644c8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1303 microversion: 2.1 time: 0.171220 Aug 17 11:24:24.369718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 211/438] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:24 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:24.416900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.433749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-20d84ba4-6625-4d52-94f8-d4a9ac8346eb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1548 microversion: 2.1 time: 0.222049 Aug 17 11:24:24.434335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 228/439] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:24 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:24.454289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:24.459486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.460501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Searching by: {'deleted': False, 'project_id': '094318249c064c24a6caa73e916ed6eb'} {{(pid=120584) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 11:24:24.469544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.470040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.470500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.471220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.471672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.472092 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.563115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.multi_cell_list [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120584) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 11:24:24.663127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7c73c8d5-3d55-4433-8f71-2756cb3d7f92 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212402 Aug 17 11:24:24.669708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 212/440] 10.222.0.15 () {58 vars in 1125 bytes} [Wed Aug 17 11:24:24 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:24.675923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:24.677056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:24.683593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.684629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.685279 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.686027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:24.686671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:24.687348 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:24.843493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:24.855105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2fce672c-fb2d-4dd5-be54-756b32d56b41 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1548 microversion: 2.1 time: 0.183400 Aug 17 11:24:24.856002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 229/441] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:24 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:25.231218 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:25.232544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:25.239901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:25.240628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:25.241120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:25.242150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:25.242603 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:25.243021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:25.393763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:25.394367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:25.400413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:25.417850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:25.419548 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:25.421020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:25.423419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:25.426767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:25.427672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:25.466365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:25.476845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d19ded4c-4a9f-44b4-a918-43dac70ceb37 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.251872 Aug 17 11:24:25.477517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 213/442] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:25 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:25.530333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:25.541862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-01537cc1-e893-4811-91e3-fefc8afad1a0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1303 microversion: 2.1 time: 0.151964 Aug 17 11:24:25.543024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 230/443] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:25 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:26.506478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:26.506944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:26.512639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:26.513127 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:26.513648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:26.514351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:26.514799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:26.515216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:26.691224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:26.699873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fedf5ff3-48e8-4302-9b05-e6f6a46a6c3e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.204272 Aug 17 11:24:26.700579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 231/444] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:26 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:26.705080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:26.705700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:26.712539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:26.713285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:26.713795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:26.714536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:26.714922 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:26.715619 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:26.728522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4ec3cf0c-3e1b-4dbc-8865-bb56b6234e28 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Action: 'create', calling method: .version_select at 0x7f90442279d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1225781617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeRp3P6WklSVBLj9TAZqgT1Jl8fypZx4h/2pRynPzhlCXRI4QninWTlmcHnD4LYHwVcexo0J1UUtYSUtxRCfax5R926dIqK8Xh5ck2YMDfsQH7WyLH8/jYpjmrSO7UwGA=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:26.752925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-4ec3cf0c-3e1b-4dbc-8865-bb56b6234e28 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Getting quotas for project f442a74602f84e66a7615de64165786a. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:24:26.758623 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-4ec3cf0c-3e1b-4dbc-8865-bb56b6234e28 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Getting quotas for user 9fedc8ba1f054629b21407989ac53a44 and project f442a74602f84e66a7615de64165786a. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:24:26.794004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4ec3cf0c-3e1b-4dbc-8865-bb56b6234e28 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299822 Aug 17 11:24:26.794945 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 214/445] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:24:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:26.921046 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:26.935156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5ec64287-c899-4c9c-93e5-f0839da1c62a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.229078 Aug 17 11:24:26.935828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 232/446] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:26 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:27.720262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:27.720880 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:27.723450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:27.731240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:27.731791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:27.731997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:27.732867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:27.733571 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:27.734007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:27.878296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:27.886672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4cc54613-b478-468b-b85b-1b43ae62b4e5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.170193 Aug 17 11:24:27.887642 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 215/447] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:27 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:27.956520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:27.957140 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:27.963755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:27.964244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:27.964671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:27.965710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:27.966224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:27.966563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:28.131227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:28.136917 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:28.145182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-24a9fbdb-aa51-454d-93a3-4c60e872802f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.192788 Aug 17 11:24:28.146338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 233/448] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:27 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:28.806229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:28.819274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:28.820473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:28.820960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:28.832281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] Creating event network-changed:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:24:28.838013 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-5aaee06d-8579-4f76-a159-77e5c138b619 req-0b548147-bb0a-41fe-9f0a-031f0ebfd2c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035565 Aug 17 11:24:28.839539 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 216/449] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:24:28.915536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:28.917733 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:28.925597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:28.926261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:28.926807 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:28.927419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:28.927883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:28.928295 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:29.094986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:29.103315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-263082a5-f38d-4cc9-9e2f-c7c1d1c25a57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.193308 Aug 17 11:24:29.105591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 234/450] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:28 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:29.171037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:29.171731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:29.178045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:29.178528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:29.178960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:29.179747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:29.180241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:29.180659 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:29.317447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:29.325331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f2df7b1d-c3c5-4748-9ce1-c18c14822a1e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.158465 Aug 17 11:24:29.325998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 217/451] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:29 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:30.127369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:30.128162 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:30.134929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:30.135432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:30.135914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:30.136613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:30.137052 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:30.137555 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:30.273406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:30.281144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-430502a1-2fcf-4838-a159-f163649ecfa4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.160860 Aug 17 11:24:30.281761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 235/452] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:30 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:30.351044 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:30.353459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:30.365573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:30.365888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:30.366337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:30.367051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:30.367578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:30.367921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:30.507770 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:30.515887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e2806dd7-9a29-4ff3-973e-e1c22a439d30 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.172086 Aug 17 11:24:30.516440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 218/453] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:30 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:31.301026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:31.301697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:31.307756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.308230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.308635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:31.309315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.309790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.310205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:31.451759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:31.459690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b09bd253-bad7-4266-9153-88459a7e94b2 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.162548 Aug 17 11:24:31.460277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 236/454] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:31 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:31.536573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:31.537219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:31.544658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.545145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.545645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:31.546349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.546806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.547490 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:31.687090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:31.695542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ba1cf70a-3e0e-4b65-b01a-065be6c742be tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.162554 Aug 17 11:24:31.701528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 219/455] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:31 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:31.912335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5416338-8615-4d3b-924a-9340bddadf12"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:31.912335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:31.920223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.920712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.921170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:31.921902 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:31.922365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:31.922750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:32.481823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:32.482900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:32.491906 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:32.492769 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:32.492983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:32.493993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:32.495175 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:32.495833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:32.556766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-57501c0d-4fcf-4a78-828c-b4aee1fbd6e4 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651095 Aug 17 11:24:32.558031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 237/456] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:24:31 2022] POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:24:32.723203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:32.724064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:32.733720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:32.739942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:32.740904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:32.741656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:32.742663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:32.743522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:32.744186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:32.744466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-44345fc9-400b-42a9-9ea5-839fba587e04 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.266518 Aug 17 11:24:32.746146 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 220/457] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:32 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:24:33.024497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:33.044077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9e32984d-7f94-4cfa-8c84-b438eed9cb7a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.329786 Aug 17 11:24:33.058543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 238/458] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:32 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:33.770953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:33.771484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:33.777782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:33.778257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:33.778685 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:33.779355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:33.779801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:33.780220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:33.938069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:33.955423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d6554451-0eb6-4bb0-bca6-daf20f58892e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.188431 Aug 17 11:24:33.955999 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 221/459] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:33 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:34.067559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:34.068359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:34.075406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:34.075996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:34.076559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:34.077279 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:34.077926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:34.078339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:34.273349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:34.280941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8bce0b1e-5863-4322-b432-3b4b2cb5e1c4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.218744 Aug 17 11:24:34.281582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 239/460] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:34 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:34.976672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:34.977238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:34.979152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:34.985162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:34.985677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:34.986107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:34.986792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:34.987247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:34.987664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:35.130939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:35.141849 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-06e1f70a-845c-49b6-80f8-2594a5ed2d96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.168996 Aug 17 11:24:35.142589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 222/461] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:34 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:35.302741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:35.303351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:35.310038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:35.310743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:35.311293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:35.311955 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:35.312598 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:35.313012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:35.474397 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:35.484440 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-aa867178-a735-498d-9253-4768ed4538c3 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.186033 Aug 17 11:24:35.485365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 240/462] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:35 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:35.705910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4", "name": "network-vif-plugged", "status": "completed", "tag": "4e8eeb5c-c626-4304-a2e4-c55bcee1bed8"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:24:35.715236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:35.715800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:35.716178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:35.727240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] Creating event network-vif-plugged:4e8eeb5c-c626-4304-a2e4-c55bcee1bed8 for instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 on hv-cinder-85345 Aug 17 11:24:35.732240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-8ac366da-0217-430a-9e62-e710d5010139 req-c1503975-17ee-4f60-9682-8926af4a5cee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Aug 17 11:24:35.732751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 223/463] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:24:36.166032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:36.166665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:36.173289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:36.173900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:36.174346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:36.175057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:36.175524 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:36.175956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:36.308675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:36.317115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-00365a94-dd7b-46e0-b2a4-0380f7070e33 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.155510 Aug 17 11:24:36.317704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 241/464] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:36 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:36.508087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:36.508872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:36.515687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:36.516171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:36.516568 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:36.517300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:36.517775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:36.518189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:36.653503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:36.665558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-68b0692e-ba0e-48c3-b184-d4c3b5ee758b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.162285 Aug 17 11:24:36.666357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 224/465] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:36 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:37.338715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:37.339335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:37.346382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:37.346865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:37.347296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:37.347993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:37.348445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:37.348866 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:37.498174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:37.508846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3a3e9239-01cd-4ca8-a233-3ff6149f34bd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.173860 Aug 17 11:24:37.509697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 242/466] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:37 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:37.691677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:37.692643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:37.695549 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=20 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:37.701633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:37.702111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:37.702538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:37.703217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:37.703663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:37.704081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:37.834166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:37.837720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:37.842357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b1d13f35-18ed-4bcd-be6e-a6bb5e38cfa9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.157179 Aug 17 11:24:37.842941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 225/467] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:37 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:38.537311 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:38.538003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:38.545217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:38.545736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:38.546164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:38.546851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:38.547298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:38.547720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:38.694446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:38.702770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-196c1e15-436c-4248-95a0-b793f3525ff6 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.171523 Aug 17 11:24:38.703331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 243/468] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:38 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:38.866353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:38.867077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:38.874262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:38.874749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:38.875184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:38.875874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:38.876329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:38.876755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:39.010331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:39.018653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a42412d0-ae25-4774-a6c1-00efa6dfe64e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.158985 Aug 17 11:24:39.019212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 226/469] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:38 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:39.731644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:39.732205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:39.739464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:39.739949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:39.740377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:39.741076 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:39.741548 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:39.741969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:39.880273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:39.889261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-43aab70f-eaec-4d9a-abae-c5f410f7e0c9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.160887 Aug 17 11:24:39.889261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 244/470] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:39 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:40.039315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:40.039975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:40.046678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:40.047170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:40.047632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:40.048308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:40.048763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:40.049191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:40.185335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:40.193119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1695bdf2-19dc-4ca7-bef6-eaa15fb466b0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.157839 Aug 17 11:24:40.193701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 227/471] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:40 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:40.913357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:40.914582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:40.921438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:40.921950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:40.922374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:40.923070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:40.923517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:40.923933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:41.057737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:41.065598 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-efc6cb9d-175b-480b-a2d3-afc0fb47744b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.158884 Aug 17 11:24:41.066194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 245/472] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:40 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:41.215514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:41.216221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:41.223819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:41.224397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:41.224876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:41.225682 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:41.226189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:41.226657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:41.361873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:41.369649 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c0e9f3fe-0bd2-40ac-8ada-30b19c90e9fc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.158816 Aug 17 11:24:41.370187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 228/473] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:41 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:42.087266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:42.087962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:42.094629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:42.095106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:42.095531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:42.096219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:42.096665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:42.097083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:42.227288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:42.234807 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a2959911-f5f1-4431-9e4a-51a5b56bdb36 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.151651 Aug 17 11:24:42.235368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 246/474] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:42 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:42.390710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:42.391279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:42.398141 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:42.398615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:42.399041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:42.399721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:42.400143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:42.400586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:42.540053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:42.547625 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-065774fe-3acb-45ca-93a9-3f4750ce5907 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.160835 Aug 17 11:24:42.548165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 229/475] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:42 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:43.255699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:43.256339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:43.262771 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:43.263244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:43.263664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:43.264345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:43.264786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:43.265200 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:43.397632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:43.405468 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bdf6a539-232e-4067-95c7-4668c8caed96 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.153628 Aug 17 11:24:43.406055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 247/476] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:43 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:43.569451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:43.570482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:43.577577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:43.577976 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:43.578408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:43.579093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:43.579545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:43.579962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:43.715060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:43.722932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e22d61c9-0109-450c-a00f-0efb74a3527a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.158046 Aug 17 11:24:43.723588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 230/477] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:43 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:44.426638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:44.427235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:44.434090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:44.434564 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:44.434990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:44.435683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:44.436128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:44.436549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:44.573178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:44.580726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-28834229-4e8a-4d06-afca-051577e307d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.158021 Aug 17 11:24:44.581294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 248/478] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:44 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:44.744380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:44.744985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:44.751910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:44.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:44.752874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:44.753605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:44.754064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:44.754489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:44.886315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:44.893980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5dbd8803-1ef3-4e23-8e21-81367cdc6dd0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.153700 Aug 17 11:24:44.894563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 231/479] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:44 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:45.606779 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:45.608379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:45.619916 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:45.620533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:45.620976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:45.621731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:45.622270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:45.622707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:45.627296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:45.763216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:45.771772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4e33e6f0-0d73-44eb-97a9-582c906d3b23 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.172359 Aug 17 11:24:45.772657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 249/480] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:45 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:45.917441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:45.918112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:45.925191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:45.925711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:45.926147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:45.926849 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:45.927296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:45.927716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:46.062036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:46.069496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7656152a-d250-4c32-9637-c312eae3090c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.157011 Aug 17 11:24:46.070404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 232/481] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:45 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:46.796576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:46.797472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:46.801050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=64 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:46.809730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:46.810541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:46.811256 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:46.812391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:46.813194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:46.813936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:46.963414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:46.972202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-497cc763-e97e-480d-b9dc-a04999a1f926 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.182282 Aug 17 11:24:46.972758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 250/482] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:46 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:47.095201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:47.096001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:47.107309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:47.108112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:47.108843 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:47.110089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:47.110850 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:47.111554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:47.242914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:47.250487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-59f994a7-a860-467a-b4de-3209e8c40989 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.162092 Aug 17 11:24:47.250998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 233/483] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:47 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:47.997351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:47.997799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:48.004513 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:48.006022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:48.006022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:48.006256 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:48.006564 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:48.006977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:48.151035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:48.160041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-42327029-893b-491b-9e34-caee446ea1ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.168578 Aug 17 11:24:48.161019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 251/484] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:47 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:48.275472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:48.276516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:48.286660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:48.287461 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:48.288179 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:48.289311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:48.290121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:48.290821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:48.644202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:48.652045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-672a3486-8097-44b4-ae56-94b591f124da tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.383220 Aug 17 11:24:48.652761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 234/485] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:48 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:49.184553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:49.185160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:49.192354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:49.192847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:49.193285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:49.194034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:49.194495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:49.195207 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:49.330294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:49.341197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f5bf7caa-4d2c-4b0a-9da8-f553807783ac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.160868 Aug 17 11:24:49.341821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 252/486] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:49 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:49.672425 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:49.673111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:49.679816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:49.680376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:49.680871 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:49.681684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:49.682127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:49.682538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:49.828897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:49.837141 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6f586ef8-561e-41d2-a4b5-576fca22b5b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.168532 Aug 17 11:24:49.837765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 235/487] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:49 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:50.365729 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:50.366702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:50.376672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:50.377400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:50.378104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:50.379139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:50.379827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:50.380459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:50.514290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:50.522203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-19d34de9-a4d7-4977-8f50-9855ece081dd tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.162460 Aug 17 11:24:50.522770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 253/488] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:50 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:50.857873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:50.858483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:50.865267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:50.865784 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:50.866213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:50.866902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:50.867351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:50.867774 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:51.004227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:51.013999 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a70cdf74-17cb-4f3d-b78c-3d5debeafd4a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.159998 Aug 17 11:24:51.014572 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 236/489] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:50 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:51.542577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:51.543119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:51.549923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:51.550410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:51.550839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:51.551534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:51.551987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:51.552409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:51.685926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:51.693401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-612f8855-2400-4cdf-a36d-8ff5d258986a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.154844 Aug 17 11:24:51.693997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 254/490] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:51 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:52.034852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:52.035569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:52.042412 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:52.042909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:52.043334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:52.044033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:52.044485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:52.044904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:52.181472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:52.190196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-12b47201-7893-4e7d-b316-b2ae29e8774f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.159223 Aug 17 11:24:52.190773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 237/491] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:52 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:52.714783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:52.715365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:52.722129 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:52.722565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:52.722883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:52.723560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:52.724007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:52.724527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:52.856703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:52.864215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d1fe2a20-3822-4684-9282-caa90c25327b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.153316 Aug 17 11:24:52.864771 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 255/492] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:52 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:53.218801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:53.219365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:53.226304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:53.226789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:53.227226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:53.227916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:53.228373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:53.228795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:53.360969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:53.369113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-24c008e6-3e1c-47c4-9ca9-eb27668df87f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.154082 Aug 17 11:24:53.369894 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 238/493] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:53 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:53.884437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:53.885008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:53.891891 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:53.892371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:53.892806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:53.893521 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:53.893986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:53.894409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:54.039000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:54.046636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0b31bca3-c626-4285-9293-e12d4a1b4307 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.166133 Aug 17 11:24:54.047200 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 256/494] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:53 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:54.391065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:54.391677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:54.398358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:54.398839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:54.399269 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:54.399959 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:54.400401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:54.400793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:54.532269 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:54.543767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-00a77d4f-9e00-4aa4-8bda-369d030ac2f4 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.156307 Aug 17 11:24:54.544488 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 239/495] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:54 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:55.066867 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:55.067474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:55.075019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:55.075472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:55.075896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:55.076575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:55.077019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:55.077454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:55.222114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:55.229653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-59d4f693-fa9d-4628-8ffc-911d4562a911 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.166584 Aug 17 11:24:55.230202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 257/496] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:55 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:55.567482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:55.568306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:55.577275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:55.577788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:55.578213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:55.578893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:55.579342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:55.579763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:55.714563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:55.725772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-49d52a60-9cf0-4b9b-9226-158a932072ee tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.164438 Aug 17 11:24:55.726457 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 240/497] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:55 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:56.254812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:56.255629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:56.264493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:56.264972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:56.265388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:56.266136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:56.266580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:56.266990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:56.396029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:56.403859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-590b5659-43f1-4e3d-8da8-377a122f851b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.155796 Aug 17 11:24:56.404401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 258/498] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:56 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:56.751254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:56.752316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:56.763256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:56.764053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:56.764771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:56.766030 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:56.766782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:56.767468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:56.904436 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:56.912259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6a2df204-b956-41c4-96e7-1398a0032480 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.167685 Aug 17 11:24:56.912831 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 241/499] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:56 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:57.424495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:57.425097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:57.432042 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:57.432502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:57.432966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:57.433686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:57.434128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:57.434539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:57.567860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:57.579952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5558464b-68a6-4b86-85bc-de941e296c7d tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.159066 Aug 17 11:24:57.580797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 259/500] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:57 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:57.934214 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:57.934874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:57.937212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=54 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:57.942597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:57.943082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:57.943518 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:57.944204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:57.944660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:57.945396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:57.963429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:58.079149 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:58.090292 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-30e5602b-1021-4784-b2b4-e0c756ca60a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.159839 Aug 17 11:24:58.091059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 242/501] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:57 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:58.600877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:58.601471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:58.608588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:58.609065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:58.609514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:58.610206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:58.610642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:58.611060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:58.750554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:58.762107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-30b931eb-e366-45e2-ae0b-30c594bc4526 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.164659 Aug 17 11:24:58.762831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 260/502] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:58 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:59.111737 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:59.112202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:59.119038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:59.119609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:59.120114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:59.120918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:59.121382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:59.121887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:59.260211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:59.268163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f81a4266-a88f-4327-a5b9-344de4add9cb tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.160623 Aug 17 11:24:59.268833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 243/503] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:59 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:24:59.787571 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:24:59.788580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:24:59.799601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:59.800405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:59.801128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:59.802326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:24:59.803087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:24:59.803796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:24:59.958977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:24:59.967835 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-889cfe6a-4294-4ce4-a2ef-88b10c6603f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.186908 Aug 17 11:24:59.968461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 261/504] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:24:59 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:00.188977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "name": "network-vif-plugged", "status": "completed", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:00.201084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:00.201866 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:00.202548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:00.214733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] Creating event network-vif-plugged:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:25:00.220299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-02064d40-e5fc-4f53-993e-d2b8c7ad59fe req-8d02719f-bf19-4273-9456-3f55e8c567b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035047 Aug 17 11:25:00.220946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 244/505] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:00.288859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:00.288859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:00.295757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:00.296230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:00.296650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:00.297337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:00.297808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:00.298288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:00.436606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:00.444103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-35a96c17-dd75-4929-b93e-374a4e57d377 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.159762 Aug 17 11:25:00.444666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 262/506] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:00 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:00.992213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:00.993345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:01.003336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:01.004175 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:01.004853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:01.005954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:01.006644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:01.007342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:01.147802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:01.155760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b6cd1da8-a7dc-424c-8f2c-0e1f2583a4e8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1318 microversion: 2.1 time: 0.170143 Aug 17 11:25:01.156315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 245/507] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:00 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:01.465135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:01.465789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:01.472606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:01.473087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:01.473541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:01.474220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:01.474705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:01.475113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:01.611122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:01.622585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a47354ce-a33d-4d77-a43b-52aaad668c7f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.160984 Aug 17 11:25:01.623221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 263/508] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:01 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:02.177401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:02.178137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:02.185848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:02.186660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:02.187417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:02.189510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:02.190198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:02.191790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:02.345148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:02.352977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9cf37eea-8435-4d54-8667-ef766e49b6f4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1507 microversion: 2.1 time: 0.179553 Aug 17 11:25:02.353573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 246/509] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:02 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:02.651774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:02.652364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:02.659525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:02.660230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:02.660901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:02.661817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:02.662480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:02.662899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:02.805990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:02.815599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-db1376d1-cb68-45c5-98f8-3dc3179e1182 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.168416 Aug 17 11:25:02.816166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 264/510] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:02 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:03.488227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:03.488966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:03.496451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:03.496943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:03.497501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:03.498287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:03.498814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:03.499242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:03.640684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:03.649291 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7cf66f35-754a-4b41-8104-720d86c8aa89 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1594 microversion: 2.1 time: 0.164997 Aug 17 11:25:03.649896 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 247/511] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:03 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:25:03.838719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:03.842299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:03.849095 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:03.849978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:03.850466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:03.851258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:03.851904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:03.852364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:04.012268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:04.015963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:04.021398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fcce0444-03e7-4c09-acf9-d0b4f86e32ea tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.188384 Aug 17 11:25:04.022157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 265/512] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:03 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:05.043183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:05.043867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:05.056387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:05.056865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:05.057300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:05.058029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:05.058482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:05.058898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:05.200365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:05.207952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-110be3da-5a7a-4e13-a494-df59449f8118 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1371 microversion: 2.1 time: 0.169463 Aug 17 11:25:05.208516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 248/513] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:05 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:05.747992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:05.759717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:05.760193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:05.760614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:05.776210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] Creating event network-changed:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:25:05.782029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-528e21a6-0f6f-4518-b7b6-710d65a26992 req-db7073d8-d2e1-4c29-aed5-84ff56dbca8a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037661 Aug 17 11:25:05.786208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 266/514] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:06.228520 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:06.229162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:06.245921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:06.250001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:06.250543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:06.251418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:06.252079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:06.252728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:06.436546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:06.445356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a9e2b225-c300-4d2e-ae7b-548cfe71e214 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1564 microversion: 2.1 time: 0.220591 Aug 17 11:25:06.448385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 249/515] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:06 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:06.474921 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:06.475944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:06.483781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:06.484400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:06.484929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:06.485943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:06.486497 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:06.487071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:06.579050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6224206e-391d-4905-800b-55f3b532db9b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111584 Aug 17 11:25:06.579815 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 267/516] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:25:06 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:07.266563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1471192140"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:07.267738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:07.274888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:07.275650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:07.276256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:07.277125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:07.277758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:07.278354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:07.792768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.network.security_group_api [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Adding security group 4663383f-0f62-4f30-bf80-4d32e703e48e to port 005c32c2-bb33-4a13-8ab3-524199fd3cbd Aug 17 11:25:08.479915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-45da273c-a3bd-4d31-8c79-07327bcf8140 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action" status: 202 len: 0 microversion: 2.1 time: 1.221916 Aug 17 11:25:08.484547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 250/517] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:25:07 2022] POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action => generated 0 bytes in 1224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:25:08.490550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:08.491364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:08.499117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:08.500177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:08.526049 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:08.533590 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:08.534731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:08.535415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:08.536771 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:08.551994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:08.559458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:08.560318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:08.599739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] Creating event network-changed:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:25:08.613037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-5591ee99-fc0f-4338-b233-0b9c438c86af req-e4b3ea32-4ae5-4174-b8f7-1547aa8457d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110994 Aug 17 11:25:08.615626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 251/518] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:25:08.789157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:08.798327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-07c90b2f-342d-4149-ad37-152e61668641 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1760 microversion: 2.1 time: 0.311942 Aug 17 11:25:08.799231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 268/519] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:08 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1760 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:10.629579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:10.640052 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:10.640820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:10.641447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:10.652917 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] Creating event network-changed:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:25:10.657768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-963701fc-8ebb-47cf-bdda-73cefc680f58 req-338948a4-9ad3-4d84-a7fa-9f59788ac0df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Aug 17 11:25:10.658518 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 252/520] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:13.302631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1132191798", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:13.359025 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] validate_networks() for None {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:25:13.635226 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:25:13.635662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:25:13.636148 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:25:13.636550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:25:13.636954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:25:13.646158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:13.646635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:13.647059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:13.647740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:13.648218 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:13.648632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:13.664819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Getting quotas for project 224a73ae27e443ad8533407df9cc530c. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:25:13.668913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Getting quotas for user 305db450b57d4131960b5b02bdfd79c6 and project 224a73ae27e443ad8533407df9cc530c. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:25:13.679675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:25:13.681941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:25:13.728698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1348e6c1-1aa3-438e-b312-eb8544f2fc64 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433042 Aug 17 11:25:13.729262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 269/521] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:25:13.740984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e805814a-6fcd-42ed-ba8b-c59ebe99994f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:13.741707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e805814a-6fcd-42ed-ba8b-c59ebe99994f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:13.797697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e805814a-6fcd-42ed-ba8b-c59ebe99994f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:13.804336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e805814a-6fcd-42ed-ba8b-c59ebe99994f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1215 microversion: 2.1 time: 0.068035 Aug 17 11:25:13.805225 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 253/522] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:13 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:13.980955 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1953972085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1225781617", "security_groups": [{"name": "tempest-secgroup-smoke-1974347579"}], "networks": [{"uuid": "5485ea74-27c6-481e-9d49-f89287fd40f8"}], "block_device_mapping_v2": [{"uuid": "e3e25fd4-0adc-42aa-b882-9ee51b645f98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:14.101096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] validate_networks() for [('5485ea74-27c6-481e-9d49-f89287fd40f8', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:25:14.491960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:25:14.492470 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:25:14.492842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:25:14.493303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:25:14.493739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:25:14.503215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:14.503717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:14.504140 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:14.504868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:14.505325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:14.505780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:14.524482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Getting quotas for project f442a74602f84e66a7615de64165786a. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:25:14.528844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Getting quotas for user 9fedc8ba1f054629b21407989ac53a44 and project f442a74602f84e66a7615de64165786a. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:25:14.588863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:25:14.591098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3e25fd4-0adc-42aa-b882-9ee51b645f98',volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:25:14.738226 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5afd5773-dff6-4745-a2f3-97703ea88fa0 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.761566 Aug 17 11:25:14.738880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 270/523] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:25:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:25:14.750185 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d82e4b3a-7974-42b8-bdff-0fbe4c7ad38d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:14.750793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d82e4b3a-7974-42b8-bdff-0fbe4c7ad38d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:14.811079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d82e4b3a-7974-42b8-bdff-0fbe4c7ad38d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:14.819017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d82e4b3a-7974-42b8-bdff-0fbe4c7ad38d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1089 microversion: 2.1 time: 0.071994 Aug 17 11:25:14.819017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 254/524] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:14 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:14.831591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:14.832179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:14.838432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:14.838920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:14.839356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:14.840055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:14.840511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:14.841038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:14.915552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:14.923259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ee37a09e-2a27-4fdb-b191-117a15d4ce4d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1267 microversion: 2.1 time: 0.096080 Aug 17 11:25:14.923833 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 271/525] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:14 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:15.839349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:15.839955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:15.846832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:15.847344 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:15.847775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:15.848466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:15.848923 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:15.850192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:15.929008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:15.936641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-85de9ee7-388e-4776-b7ab-4bf99c7daea4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1187 microversion: 2.1 time: 0.101271 Aug 17 11:25:15.937300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 255/526] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:15 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:15.944601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:15.945546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:15.968808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:15.969576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:15.970217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:15.971153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:15.971799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:15.972441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:16.145932 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:16.158242 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c99e21bc-d58e-4e21-95a4-16f9c67f060c tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.217709 Aug 17 11:25:16.158920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 272/527] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:15 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:25:16.958280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:16.958894 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:16.965947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:16.966433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:16.966879 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:16.967563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:16.968018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:16.968470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:17.040281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:17.048469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b6d76d0a-df0a-48a1-8a7b-3dc287ec8e91 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1205 microversion: 2.1 time: 0.094231 Aug 17 11:25:17.049153 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 256/528] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:16 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:17.180703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:17.181369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:17.184111 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:17.192186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:17.192908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:17.193403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:17.194210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:17.195381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:17.196136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:17.355156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44693234-b62a-4053-b351-6475ed4c76df", "tag": "6089f6e0-2642-4261-8348-69306da48046"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:17.362636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:17.365889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:17.366765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:17.367433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:17.370316 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-93020cf9-ada6-4637-8ab4-c81c58356ed4 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.193768 Aug 17 11:25:17.371259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 273/529] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:17 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:17.386023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] Creating event network-changed:6089f6e0-2642-4261-8348-69306da48046 for instance 44693234-b62a-4053-b351-6475ed4c76df on hv-cinder-85345 Aug 17 11:25:17.391150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-c3711e9c-8fde-4647-8b85-761d79b6f99a req-8706c728-ceb4-4b4e-8866-2569f1f5f3ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040557 Aug 17 11:25:17.391746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 257/530] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:25:18.071005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:18.071708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:18.078398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:18.078878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:18.079296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:18.079981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:18.080423 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:18.080829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:18.218505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:18.226142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-494b7ec8-bb0b-47b8-a7c8-7840fcb4dc38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.159811 Aug 17 11:25:18.226676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 274/531] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:18 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:18.392177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:18.392920 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:18.399210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:18.399705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:18.400155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:18.400991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:18.401454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:18.401900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:18.532501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:18.539991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-71e678ae-3738-493d-9192-d45a6a846317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.152899 Aug 17 11:25:18.553474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 258/532] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:18 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:19.251467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:19.252512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:19.263287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:19.264069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:19.264769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:19.265930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:19.266682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:19.267370 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:19.410427 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:19.420904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:19.421601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:19.422201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:19.424389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:19.432335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-317ca513-4a13-4127-9dff-18f895b5dc64 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.187539 Aug 17 11:25:19.432908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 275/533] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:19 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:19.437680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] Creating event network-changed:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:25:19.447376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-d9710229-d016-4cad-a866-57d7354baabe req-260ae1fb-d8f2-44e1-8ca8-031be477ec41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041002 Aug 17 11:25:19.447950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 259/534] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:19.560158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:19.560760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:19.567183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:19.567659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:19.568082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:19.568759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:19.569203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:19.569935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:19.704627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:19.715893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-25d5c9e5-9f76-40b2-986d-78ff8efed420 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.159376 Aug 17 11:25:19.716596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 276/535] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:19 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:20.430621 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:20.431578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:20.442063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.442858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.443589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.445058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.445860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.446586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.455007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:20.455617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:20.462322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.462840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.463266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.464009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.464428 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.464879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.471146 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-116bb1be-245e-4c89-a77e-0c571c510f1c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/ips" status: 200 len: 152 microversion: 2.20 time: 0.048447 Aug 17 11:25:20.471718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 260/536] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 11:25:20 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:25:20.602887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:20.610925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-455409ee-09a3-4e07-82a5-8c442948bd8f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.159757 Aug 17 11:25:20.611590 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 277/537] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:20 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:20.742256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:20.743068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:20.750975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.751532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.752101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.752877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:20.753561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:20.754094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:20.903131 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:20.910912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cf1250a5-3509-4c39-9bf5-2532aa46cfbd tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.172693 Aug 17 11:25:20.911474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 261/538] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:20 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:21.634191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:21.635007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:21.644562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:21.645218 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:21.645805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:21.646804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:21.647415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:21.647962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:21.782592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:21.790675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3703ea94-eca5-479d-a7a8-52d99a0c7dcf tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.162194 Aug 17 11:25:21.791601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 278/539] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:21 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:21.931394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:21.931994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:21.938739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:21.939215 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:21.939638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:21.940320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:21.940751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:21.941164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:22.076033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:22.083758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-971407db-c27a-4186-85f4-84c652c33b5d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.156152 Aug 17 11:25:22.084314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 262/540] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:21 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:22.811439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:22.811984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:22.818483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:22.818961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:22.819410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:22.820438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:22.820887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:22.821302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:22.963925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:22.971551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a0d9faba-b078-41dc-a6a7-fe2c28913694 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.164546 Aug 17 11:25:22.972130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 279/541] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:22 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:23.104610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:23.105196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:23.111895 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.112382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.112821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.113543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.114003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.114430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.248838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:23.259950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-89219afc-cf2b-4ab6-8a3c-5a6fe80db074 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.159089 Aug 17 11:25:23.260735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 263/542] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:23 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:23.471820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:23.472572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:23.482161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.482642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.483072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.483755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.484209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.484624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.507953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lazy-loading 'flavor' on Instance uuid 76d1fb89-3bae-4f78-945d-175311eae82e {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:25:23.702532 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-259c6e38-70d3-449d-9bf6-cfc25d46b799 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/action" status: 202 len: 0 microversion: 2.20 time: 0.237337 Aug 17 11:25:23.703125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 280/543] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 11:25:23 2022] POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:25:23.711502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:23.712607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:23.718434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.718918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.719341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.720050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:23.720474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:23.720889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:23.847447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:23.858475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:23.860934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:23.862780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-afd1f5e1-ada9-4b65-9660-53645da4b2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.154861 Aug 17 11:25:23.863625 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 264/544] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:23 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:23.993353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:23.994159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:24.002026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.002559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.003039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:24.003835 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.004339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.004805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:24.136539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:24.144122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a147b075-de6c-476d-854a-b32c4619151a tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.155461 Aug 17 11:25:24.144666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 281/545] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:23 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:24.284181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:24.285171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:24.295209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.295682 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.296108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:24.296788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.297233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.297758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:24.301717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:24.433546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:24.441938 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c4b24170-4c27-4a5d-8f1a-11ab981123b0 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.164112 Aug 17 11:25:24.442497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 265/546] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:24 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:24.890898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:24.891507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:24.893453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:24.894137 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=12 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:24.900056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.900555 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.900967 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:24.901686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:24.902156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:24.902574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:25.034467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:25.037857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:25.043658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:25.045143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:25.046329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d3144703-99c5-4842-886a-6fa4c6e400be tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.160037 Aug 17 11:25:25.046904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 282/547] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:24 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:25.166070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:25.166735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:25.168697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=4 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:25.174408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:25.174890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:25.175316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:25.175986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:25.176437 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:25.176867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:25.462927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:25.463636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:25.471227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:25.471829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:25.472339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:25.473106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:25.473744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:25.474250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:25.544296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:25.552165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c084bec5-4ab3-401b-b624-abcfabd19ec9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.389907 Aug 17 11:25:25.552749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 266/548] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:25 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:25.625554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:25.633331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-34a69294-8bf5-4fc3-9b10-7a7011503e4f tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.174293 Aug 17 11:25:25.634086 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 283/549] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:25 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:26.072781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:26.073884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:26.084139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.084937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.085742 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.086868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.087661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.088359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.224558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:26.232759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:26.234279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:26.235451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d1b350d2-53d6-4f53-bd9c-4bcf6083083e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.169630 Aug 17 11:25:26.236017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 267/550] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:26 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:26.299149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44693234-b62a-4053-b351-6475ed4c76df", "name": "network-vif-plugged", "status": "completed", "tag": "6089f6e0-2642-4261-8348-69306da48046"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:26.310566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.311165 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.311788 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.323865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] Creating event network-vif-plugged:6089f6e0-2642-4261-8348-69306da48046 for instance 44693234-b62a-4053-b351-6475ed4c76df on hv-cinder-85345 Aug 17 11:25:26.329005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-8a54a867-be08-4fdc-99fd-d74a5605899e req-cf413f0b-e3e8-42a4-8cb4-190f92d87b3b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Aug 17 11:25:26.329774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 284/551] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:26.573184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:26.573795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:26.580513 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.580994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.581445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.582133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.582581 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.582997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.654930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:26.655616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:26.661830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.662360 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.662712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.663391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:26.663836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:26.664254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:26.740028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:26.747890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-49b4c852-3a09-41e8-91d0-4fe20464a367 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.178987 Aug 17 11:25:26.748423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 268/552] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:26 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:26.810937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:26.818694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-36fdc790-5c44-417d-8e5b-df9f6f35833e tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.168036 Aug 17 11:25:26.819266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 285/553] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:26 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:25:27.258285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:27.258895 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:27.265272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.265874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.266305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.266990 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.267470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.267890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.408068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:27.416191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:27.417739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:27.418904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e591efd8-1991-458a-a6ef-569145bd682a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.164645 Aug 17 11:25:27.419442 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 269/554] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:27 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:27.773414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:27.774476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:27.785604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.786415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.787132 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.788269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.789017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.789768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.839916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:27.840534 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:27.847329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.847824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.848258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.848948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:27.849398 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:27.849848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:27.965677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:27.973770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7c2d10c0-c1f2-4afe-a929-61a24656bf0f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.207019 Aug 17 11:25:27.974584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 286/555] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:27 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:28.010130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:28.017937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-04635700-8185-4a18-8bb8-5172c1ea17ba tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1315 microversion: 2.1 time: 0.181979 Aug 17 11:25:28.018513 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 270/556] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:27 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:28.442853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:28.443468 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:28.450380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:28.450872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:28.451294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:28.451982 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:28.452423 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:28.452836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:28.588372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:28.596933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:28.598480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:28.599694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1944c185-4dfe-4044-84be-05f895ec7654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.160938 Aug 17 11:25:28.600276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 287/557] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:28 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:28.997328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:28.999082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:29.001767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=62 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:29.007570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.008154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.008654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.009452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.009955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.010409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.038060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:29.038648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:29.045630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.046031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.046462 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.047166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.047612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.047993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.196127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.204328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f73e08ad-6b5b-442c-ac21-b5e7eac7d968 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.212490 Aug 17 11:25:29.204990 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 271/558] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:28 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:29.222027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.229721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f62b54a3-9c86-4f1d-897d-1177c760b24d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1465 microversion: 2.1 time: 0.195473 Aug 17 11:25:29.230282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 288/559] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:29 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:29.275887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:29.276380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:29.282647 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.283122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.283546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.284224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.284670 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.285084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.309957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:25:29.406097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-557fc700-72a4-4dae-a7f2-869370e37316 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "DELETE /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 204 len: 0 microversion: 2.1 time: 0.133140 Aug 17 11:25:29.406709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 272/560] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:25:29 2022] DELETE /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:25:29.417385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:29.418280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:29.424976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.425481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.425906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.426616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.427059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.427471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.561571 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.569200 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4b8f8b92-daea-4420-b5ba-4f46b62944ac tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1471 microversion: 2.1 time: 0.157862 Aug 17 11:25:29.570038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 289/561] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:29 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:29.633692 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:29.634474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:29.643409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.644125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.644733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.645882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:29.646589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:29.647266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:29.785716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.795429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.796964 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:29.798135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-925f656f-8fee-41d4-91cf-cb9dfa31c848 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.170812 Aug 17 11:25:29.798715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 273/562] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:29 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:30.229464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:30.230431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:30.238306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.238796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.239221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.239971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.240378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.240800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.378632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:30.386231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fda0c83d-0fc8-4261-88a2-7f1b7b210daa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.163296 Aug 17 11:25:30.386794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 290/563] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:30 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:30.591139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:30.591733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:30.598776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.599257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.599683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.600369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.600821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.601240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.734105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:30.741685 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1c8a0c12-458e-4558-b612-dfd320aa322d tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1471 microversion: 2.1 time: 0.154542 Aug 17 11:25:30.742227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 274/564] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:30 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:30.824877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:30.825942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:30.832520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.833008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.833459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.834167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:30.834624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:30.835047 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:30.971509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:30.979467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:30.980953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:30.982184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-fad68911-a67c-4bf4-b4d4-4af0aa9c3250 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.164102 Aug 17 11:25:30.982830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 291/565] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:30 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:31.411550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:31.412587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:31.423071 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.423860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.424566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.425815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.426555 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.427229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.490767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "689a9596-2c4d-4da9-837b-5de5d8a3629c", "device": "/dev/sdb"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:31.494030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:31.501999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.502481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.502918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.503595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.504048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.504481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.568247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:31.576605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8ee776b5-bd66-4446-8204-1b5b4084f43e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.171344 Aug 17 11:25:31.577212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 275/566] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:31 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:31.766106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:31.766775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:31.773965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.774451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.774874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.775572 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:31.776025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:31.776448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:31.912684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:31.920474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-01f2ffbe-9d03-4712-8357-d9fb96780380 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1471 microversion: 2.1 time: 0.159867 Aug 17 11:25:31.921011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 276/567] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:31 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:32.008672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:32.009772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:32.021121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.021858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.022579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:32.023764 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.024486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.025192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:32.167588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:32.178648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:32.180203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:32.181393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cbd1808c-4f2f-4e7a-8436-f45ffc6d8545 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.179150 Aug 17 11:25:32.181998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 277/568] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:32 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:32.603052 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:32.604075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:32.614411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.615206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.615921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:32.617056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.617869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.618579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:32.755216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:32.767376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cc8dd4be-5396-45b0-bb8b-68f0cf6ea852 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.170611 Aug 17 11:25:32.768000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 278/569] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:32 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:32.941889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:32.942502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:32.949759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.950154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.950586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:32.951272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:32.951726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:32.952152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:33.085638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:33.093282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1aac7417-8529-4466-ad84-e4cfe9ff43f5 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1471 microversion: 2.1 time: 0.155306 Aug 17 11:25:33.093878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 279/570] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:32 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:33.209012 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:33.209918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:33.219374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:33.220171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:33.220893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:33.222051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:33.222803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:33.223495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:33.230265 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:33.370421 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:33.378905 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:33.380413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:33.381600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b9917d93-ccd3-4fd8-9129-b6655f25087d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.179184 Aug 17 11:25:33.382158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 280/571] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:33 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:33.788351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:33.789116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:33.798280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:33.798771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:33.799199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:33.799975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:33.800345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:33.800756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:33.908114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2ec8ff44-6260-43de-8537-1b57c3deac0a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "POST /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.421208 Aug 17 11:25:33.910000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 292/572] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:25:31 2022] POST /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4/os-volume_attachments => generated 194 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:33.959017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:33.968648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b68fb455-287e-4453-854b-230f5c4e8625 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.184268 Aug 17 11:25:33.978952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 281/573] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:33 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:34.115365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:34.115930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:34.122766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:34.123437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:34.123874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:34.124645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:34.125094 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:34.125615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:34.263746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '305db450b57d4131960b5b02bdfd79c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '224a73ae27e443ad8533407df9cc530c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:34.271426 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8ec6eb37-9265-4cae-9310-0940141dd317 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 200 len: 1471 microversion: 2.1 time: 0.160860 Aug 17 11:25:34.272009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 293/574] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:34 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:34.408210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:34.408949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:34.420341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:34.420700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:34.421138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:34.421952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:34.422328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:34.422750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:34.484767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44693234-b62a-4053-b351-6475ed4c76df", "name": "network-vif-deleted", "tag": "6089f6e0-2642-4261-8348-69306da48046"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:34.508398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:34.508935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:34.509369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:34.523504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] Creating event network-vif-deleted:6089f6e0-2642-4261-8348-69306da48046 for instance 44693234-b62a-4053-b351-6475ed4c76df on hv-cinder-85345 Aug 17 11:25:34.535445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-e4f9983c-01f9-4358-9642-033ec4940c61 req-efa1f40d-86cf-4ab4-bd00-e6c6d3728633 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054383 Aug 17 11:25:34.536171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 294/575] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:25:34.602424 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:34.614690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:34.616192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:34.617389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ca07883c-9e96-4209-83eb-807a6ccc1ac8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.216464 Aug 17 11:25:34.627373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 282/576] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:34 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:34.994258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:34.995220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:35.003831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.004305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.004725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.005403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.005888 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.006298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.145034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:35.153093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cc6eeacd-0bc3-46ee-9474-245dbbb82925 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.165404 Aug 17 11:25:35.153746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 295/577] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:34 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:35.297544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:35.298545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] [instance: 44693234-b62a-4053-b351-6475ed4c76df] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:35.305309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.305825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.306245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.306926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.307371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.307783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.321469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] HTTP exception thrown: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Request method failure captured: Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df HTTP/1.1 Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NAWZqeDb5b7JFPevxOIZnGv-6gESoC7Kgp1mSLuiGHSPcawgs3mDnbomU-lgnGbRqtlBXYW1bM3d95Pw0wsv5Eux2KfhhVUm1szETu9L5_TAxJ5ZExJ80nEu4108mCd_BJOUt83f7KPCIjiCU4lv71iwNQwEXSZuHjQeOBsoQL1I6I Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 224a73ae27e443ad8533407df9cc530c Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-VolumesNegativeTest-1348005576 Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:25:35.323072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/224a73ae27e443ad8533407df9cc530c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/224a73ae27e443ad8533407df9cc530c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/224a73ae27e443ad8533407df9cc530c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_224a73ae27e443ad8533407df9cc530c", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-VolumesNegativeTest-1348005576 Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 224a73ae27e443ad8533407df9cc530c Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-VolumesNegativeTest-1348005576 Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-VolumesNegativeTest-1348005576-project Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 305db450b57d4131960b5b02bdfd79c6 Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-VolumesNegativeTest-1348005576-project Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. Aug 17 11:25:35.324592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '44693234-b62a-4053-b351-6475ed4c76df'} Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:25:35.325589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. Aug 17 11:25:35.326873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:25:35.327970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] Returning 404 to user: Instance 44693234-b62a-4053-b351-6475ed4c76df could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:25:35.327970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0d17129e-84d5-44c2-a5dc-65d7cb9d4030 tempest-VolumesNegativeTest-1348005576 tempest-VolumesNegativeTest-1348005576-project] 10.222.0.15 "GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df" status: 404 len: 111 microversion: 2.1 time: 0.033809 Aug 17 11:25:35.327970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 283/578] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:35 2022] GET /compute/v2.1/servers/44693234-b62a-4053-b351-6475ed4c76df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:25:35.639936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:35.640530 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:35.646746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.647241 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.647703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.648387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:35.648839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:35.649258 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:35.782977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:35.791692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:35.793259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:35.794580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7ef46762-8622-429c-9aeb-ecf054cd78d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.158662 Aug 17 11:25:35.795223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 296/579] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:35 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:36.173576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:36.174194 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:36.180316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:36.180805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:36.181689 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:36.182072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:36.182526 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:36.182946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:36.325339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:36.333619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7bdc77bc-e7e4-45e8-9e39-7bbab75af4c9 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.163902 Aug 17 11:25:36.334136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 284/580] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:36 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:36.817125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:36.817898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:36.825389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:36.825912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:36.826343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:36.827036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:36.827490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:36.827912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:36.968675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:36.977038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:36.978580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:36.979739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b6127898-8dca-4ccc-9084-6a04dcd75417 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.166776 Aug 17 11:25:36.980481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 297/581] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:36 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:37.353498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:37.354102 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:37.360752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:37.361219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:37.361672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:37.362365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:37.362814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:37.363226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:37.513394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:37.521236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-89bcb5ae-fa83-40ea-a736-42dbdf269445 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.171734 Aug 17 11:25:37.521910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 285/582] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:37 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:38.003644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:38.004244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:38.011244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:38.011780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:38.012215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:38.012927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:38.013378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:38.013820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:38.152301 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:38.160342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:38.161907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:38.163069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-73a15576-2255-453c-91c2-7e50542d9106 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.163629 Aug 17 11:25:38.163624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 298/583] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:37 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:38.469455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "name": "network-vif-plugged", "status": "completed", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:38.480712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:38.481177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:38.481767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:38.495096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] Creating event network-vif-plugged:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:25:38.500267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-c0b4ae11-1c48-44c5-8165-0ab7beacbbc6 req-d8a4f1f8-b16f-4aa7-a8bb-af7141050372 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034482 Aug 17 11:25:38.500984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 286/584] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:38.542227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:38.542845 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:38.549107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:38.549707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:38.550146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:38.550838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:38.551290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:38.551738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:38.571147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:38.692861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:38.701254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9f273b65-bbd2-4651-af8d-fa0f42d8e2ba tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.162913 Aug 17 11:25:38.701876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 299/585] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:38 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:39.191068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:39.192085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:39.203086 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:39.203910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:39.204625 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:39.205678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:39.206126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:39.206546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:39.335887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:39.344047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:39.345601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:39.346839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-98af125f-b11b-41f8-b93c-2c7b758faea2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.163410 Aug 17 11:25:39.347415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 287/586] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:39 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:39.722689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:39.723364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:39.730417 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:39.730904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:39.731328 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:39.732021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:39.732467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:39.732877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:39.913003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:39.921010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7e41da5e-1db8-41ce-bb25-8ab80764111c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.202694 Aug 17 11:25:39.921619 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 300/587] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:39 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:40.369687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:40.370335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:40.377389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:40.377891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:40.378324 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:40.379025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:40.379486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:40.379915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:40.526758 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:40.538891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:40.541196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:40.542947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-30bc32c0-4b0f-4ac8-acb2-06513e62603b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.177109 Aug 17 11:25:40.543767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 288/588] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:40 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:40.942971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:40.943550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:40.950760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:40.951237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:40.951665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:40.952355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:40.952786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:40.953199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:41.094308 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:41.103430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-04853ebd-7919-4aa5-a92b-733054bff52e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1261 microversion: 2.1 time: 0.164404 Aug 17 11:25:41.104350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 301/589] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:40 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:41.568222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:41.568889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:41.576775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:41.577301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:41.577816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:41.578573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:41.579070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:41.579531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:41.716196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:41.724553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:41.726068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:41.727221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0efa8c76-b945-4f1e-88ef-6b3878ed058e tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.163451 Aug 17 11:25:41.727787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 289/590] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:41 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:42.128300 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:42.129293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:42.140122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.140964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.141752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.142893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.143539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.143964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.277510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:42.287711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0a902a57-5456-49c8-852e-80d51364e81e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1444 microversion: 2.1 time: 0.165961 Aug 17 11:25:42.288281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 302/591] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:42 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:42.308318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:42.308956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:42.315607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.316054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.316574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.317291 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.317778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.318202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.451791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:42.459706 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-36fcc217-d057-4c5a-a973-00a6396301f4 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1444 microversion: 2.1 time: 0.155324 Aug 17 11:25:42.460299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 290/592] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:25:42 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:25:42.750836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:42.752007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:42.758129 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.758625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.759056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.759763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:42.760211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:42.760617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:42.997091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:43.005607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:43.007719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:43.008936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d3abac11-bb92-45c5-a60b-cfdf23a44272 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.262852 Aug 17 11:25:43.021630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 303/593] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:42 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:25:44.032444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:44.033086 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:44.040233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:44.040676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:44.041115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:44.041854 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:44.042307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:44.042729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:44.500745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:44.511403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:44.512913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:44.514111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-16071864-59ea-4fef-8bce-06f07d3fc433 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.485699 Aug 17 11:25:44.514717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 291/594] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:44 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:44.677224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:44.687105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:44.687579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:44.688037 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:44.699876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] Creating event network-changed:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:25:44.705052 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-67bbb2b4-c7c3-4a94-b15c-1aa8fab27663 req-5baaf8fa-7aca-465c-b3b1-ad0bcfd5c136 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031698 Aug 17 11:25:44.705881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 304/595] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:45.537155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:45.537825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:45.544765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:45.545255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:45.545717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:45.546412 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:45.546927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:45.547278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:45.677597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:45.685997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:45.687507 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:45.688683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cb9a2c55-51e9-453e-a107-2128ed435a2d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.155665 Aug 17 11:25:45.689250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 292/596] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:45 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:46.717784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:46.718934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:46.727077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:46.727556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:46.727986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:46.728677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:46.729130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:46.729586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:46.872495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:46.881236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:46.882764 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:46.883936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ad4074cc-b26a-4c2b-89f0-81827f760fa0 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.174449 Aug 17 11:25:46.884506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 305/597] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:46 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:47.908045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:47.908732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:47.916028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:47.916533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:47.916983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:47.917743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:47.918210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:47.918648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:48.052733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:48.061103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:48.062643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:48.063818 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8a69349d-544d-4ff2-950d-0c641f2e49f1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.160264 Aug 17 11:25:48.064389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 293/598] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:47 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:49.092091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:49.093041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:49.097030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=66 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:49.103357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:49.103838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:49.104299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:49.104990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:49.105493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:49.105907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:49.239976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:49.247995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:49.249476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:49.250655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-dd6d4cae-b97f-45cd-b95f-190270f7f687 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.165247 Aug 17 11:25:49.251222 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 306/599] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:49 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:50.278930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:50.279804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:50.290690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:50.291477 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:50.292189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:50.293315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:50.294204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:50.294898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:50.427451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:50.435793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:50.437275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:50.438450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1e0f4341-8d42-4f8e-8f42-7bc8aa632024 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.166472 Aug 17 11:25:50.438994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 294/600] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:50 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:51.462037 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:51.462646 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:51.469560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:51.470057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:51.470493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:51.471171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:51.471614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:51.472011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:51.612156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:51.621080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:51.622736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:51.623893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7b854d19-78b1-4be3-a6db-dae5cd7a09e8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.165974 Aug 17 11:25:51.624433 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 307/601] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:51 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:52.654072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:52.655026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:52.664903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:52.665379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:52.665834 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:52.666529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:52.666974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:52.667391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:52.801731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:52.809852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:52.811354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:52.812502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8cea06ab-bba2-4a40-8858-74af99fab2e1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.165035 Aug 17 11:25:52.813067 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 295/602] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:52 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:53.838353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:53.839037 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:53.845772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:53.846240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:53.846667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:53.847335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:53.847776 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:53.848186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:53.977163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:53.985557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:53.987032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:53.988198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-795f52f3-eea3-4703-b5b4-f14650d48183 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.154831 Aug 17 11:25:53.988757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 308/603] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:53 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:55.012498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:55.013078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:55.020466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:55.020952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:55.021385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:55.022115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:55.022563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:55.023027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:55.160654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:55.168690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:55.170223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:55.171372 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ca8881bc-88ab-40b3-b0bf-a106bb089313 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.163423 Aug 17 11:25:55.171926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 296/604] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:55 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:56.199328 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:56.200407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:56.210944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:56.211428 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:56.211856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:56.212569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:56.213013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:56.213468 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:56.347644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:56.355852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:56.357841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:56.359168 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0db24545-a79f-4b5b-9890-d2d25caf15de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.167081 Aug 17 11:25:56.359898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 309/605] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:56 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:56.864696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "name": "network-vif-plugged", "status": "completed", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:25:56.875228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:56.875729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:56.876148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:56.887657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] Creating event network-vif-plugged:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:25:56.892991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-e0f4c4b9-5a46-44e9-8e64-b90e355b82d3 req-6f32386b-ae4e-4aa1-8ea2-ed3bcbcf0331 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 Aug 17 11:25:56.893629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 297/606] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:25:57.384805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:57.386001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:57.394538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:57.394990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:57.396503 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:57.397209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:57.397737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:57.398481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:57.532518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:57.544743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:57.547074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:57.548774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-680663c2-354a-41e2-b5f2-41140b7de2e2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1745 microversion: 2.20 time: 0.168563 Aug 17 11:25:57.549579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 310/607] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:57 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:58.574584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:58.575297 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:58.597810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:58.598554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:58.599163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:58.600473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:58.601154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:58.601657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:58.749996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:58.754011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:58.759794 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:58.761947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:58.763142 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e82ff827-1dc9-4b28-9080-b4dc9ba4705b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.194528 Aug 17 11:25:58.764148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 298/608] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:58 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:25:59.786966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:25:59.787615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:25:59.794566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:59.795247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:59.795844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:59.796718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:25:59.797313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:25:59.797918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:25:59.977844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:59.988811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:59.990719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:25:59.992156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-18330216-81f4-42a2-a5d3-c283b5c682e7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.209081 Aug 17 11:25:59.993149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 311/609] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:25:59 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:01.015612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:01.019754 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:01.023805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:01.030518 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:01.031323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:01.031967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:01.033040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:01.033586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:01.034008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:01.229060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:01.237936 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:01.239514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:01.240769 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2531294c-3a43-44d9-bf27-fb88306aeba6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.229269 Aug 17 11:26:01.241410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 299/610] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:01 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:02.265394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:02.266011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:02.273176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:02.273697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:02.274129 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:02.274827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:02.275285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:02.275705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:02.415745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:02.425957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:02.427538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:02.429544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-11557603-cc30-47c4-b84d-662273166857 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.168144 Aug 17 11:26:02.430348 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 312/611] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:02 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:03.453606 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:03.455058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:03.462296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:03.462868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:03.463363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:03.464114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:03.464756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:03.465376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:03.607974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:03.617915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:03.619410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:03.620567 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f0e2bbf3-fe0f-44d9-83f9-036d37e0cbba tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.171032 Aug 17 11:26:03.621241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 300/612] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:03 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:04.643841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:04.644437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:04.651018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:04.651507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:04.652038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:04.652734 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:04.653186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:04.653645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:04.788475 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:04.796888 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:04.798711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:04.799887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-22c5e74a-cf7d-4fd9-9c3e-16d95646a7a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.159960 Aug 17 11:26:04.800452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 313/613] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:04 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:05.823524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:05.824216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:05.830874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:05.831349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:05.831773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:05.832460 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:05.832936 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:05.833350 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:05.971765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:05.979257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:05.980768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:05.982174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3448b981-1b99-457e-ac31-653843a06db9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.162854 Aug 17 11:26:05.985759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 301/614] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:05 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:07.004593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:07.005204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:07.012202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:07.012930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:07.013573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:07.014263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:07.014919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:07.015410 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:07.162791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:07.171544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:07.173389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:07.174826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b50de383-e94e-4b39-a87b-7ae4fa598c04 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.174039 Aug 17 11:26:07.189931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 314/615] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:06 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:08.198751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:08.199506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:08.209186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:08.209702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:08.210385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:08.211096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:08.211550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:08.211978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:08.228585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:08.229099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:08.236138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:08.236705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:08.237145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:08.237951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:08.238650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:08.239290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:08.362353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:08.374479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:08.375925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:08.377089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7a9f75f4-db25-4e16-a744-1bcdcabded21 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.183201 Aug 17 11:26:08.377875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 302/616] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:08 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:08.400674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lazy-loading 'services' on Instance uuid 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:26:08.519958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0fa4097d-90ca-4d2e-ae95-001ca65c27ed tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4/os-volume_attachments/689a9596-2c4d-4da9-837b-5de5d8a3629c" status: 202 len: 0 microversion: 2.1 time: 0.295410 Aug 17 11:26:08.520545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 315/617] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:26:08 2022] DELETE /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4/os-volume_attachments/689a9596-2c4d-4da9-837b-5de5d8a3629c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:26:09.402792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:09.403584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:09.411921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:09.412523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:09.413051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:09.413958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:09.414514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:09.415035 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:09.552277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:09.564761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:09.567021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:09.568920 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-227e4182-e9fc-45d9-8836-0d2aa49ce1f8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1740 microversion: 2.20 time: 0.171403 Aug 17 11:26:09.570153 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 303/618] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:09 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:10.594255 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:10.594938 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:10.603017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.603505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.603920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.604637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.605086 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.605535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.608821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:10.701301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:10.701841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:10.708543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.709019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.709555 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.710246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.710744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.711157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.736005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:26:10.741544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:10.749681 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:10.751217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:10.752368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b5cba217-e77a-4040-8ec1-ef862e478b7b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1722 microversion: 2.20 time: 0.162556 Aug 17 11:26:10.752923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 316/619] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:10 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:10.813827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4826d3b8-1586-4ec1-8587-483bba2039d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 204 len: 0 microversion: 2.1 time: 0.116182 Aug 17 11:26:10.814404 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 304/620] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:26:10 2022] DELETE /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 11:26:10.823051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:10.823710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:10.829764 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.830249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.830672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.831355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:10.831796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:10.832204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:10.963457 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:10.971043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3d322737-95bc-49c6-95ec-6f95a3ed690c tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1513 microversion: 2.1 time: 0.152174 Aug 17 11:26:10.971600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 317/621] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:10 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:11.781005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:11.782226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:11.792632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:11.793224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:11.793792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:11.794641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:11.795169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:11.795707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:11.935801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:11.948147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:11.949140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:11.950316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-de9b1e65-5bf2-4ca4-8802-52e7994b1901 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1722 microversion: 2.20 time: 0.176604 Aug 17 11:26:11.950907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 305/622] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:11 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:11.992448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:11.992991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:11.999931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:12.000429 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:12.000862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:12.001589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:12.002041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:12.002465 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:12.136032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:12.143736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4d7b53b9-c582-4056-8dfb-548584c15660 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1513 microversion: 2.1 time: 0.155323 Aug 17 11:26:12.144329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 318/623] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:11 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:12.765653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "name": "network-vif-unplugged", "status": "completed", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:12.776508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:12.776961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:12.777462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:12.789126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] Creating event network-vif-unplugged:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:26:12.794020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-097f0de1-c143-4608-a429-38f7bf17b483 req-abf213f1-4803-4ec3-a7c3-04b177b2bbcc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032153 Aug 17 11:26:12.794599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 306/624] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:26:12.977542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:12.978467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:12.988861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:12.989718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:12.990419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:12.991592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:12.992327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:12.993010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:13.132120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:13.140499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:13.142205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:13.143449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-99956abb-9eff-49a2-951c-695524dd3822 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1722 microversion: 2.20 time: 0.172814 Aug 17 11:26:13.144038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 319/625] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:12 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:13.165619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:13.166303 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:13.173058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:13.173578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:13.174019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:13.174716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:13.175169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:13.175592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:13.314225 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:13.322415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9ada5059-e8e0-4b91-8e9e-ca90f1530731 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1513 microversion: 2.1 time: 0.161098 Aug 17 11:26:13.323025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 307/626] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:13 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:14.169458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:14.170178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:14.177816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.178360 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.178837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.179585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.180080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.180538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.321143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:14.329233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:14.330739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:14.331875 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-39606318-f532-484d-9fba-7e3018270530 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1725 microversion: 2.20 time: 0.167524 Aug 17 11:26:14.332439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 320/627] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:14 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:14.343780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:14.344468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:14.351248 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.351762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.352188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.352877 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.353327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.353873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c17b6411-d3ce-44c0-8c70-bca7693f6ffb"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:14.354219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.356281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:14.362354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.362832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.363260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.363947 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.364392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.364803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.484861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:14.493116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0fad6d2b-4f4e-47d5-83fa-c5b1bd1c9206 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1513 microversion: 2.1 time: 0.153387 Aug 17 11:26:14.493865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 308/628] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:14 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:14.669996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ce3d906d-8f03-404a-938a-f33a492520d9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319870 Aug 17 11:26:14.670629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 321/629] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 11:26:14 2022] POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 11:26:14.796657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:14.797410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:14.803529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.804010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.804457 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.805134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.805621 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.806032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.848235 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120584) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 11:26:14.919813 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-14e34138-2dab-42db-826b-cf779ca75c6a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/action" status: 202 len: 0 microversion: 2.20 time: 0.127146 Aug 17 11:26:14.923407 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 309/630] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 11:26:14 2022] POST /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:26:14.930359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:14.930359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:14.936197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.936706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.937144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:14.937905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:14.938360 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:14.938783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:15.084628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:15.091979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4", "name": "network-vif-deleted", "tag": "4e8eeb5c-c626-4304-a2e4-c55bcee1bed8"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:15.095184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:15.097192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:15.098592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f417072d-6c0c-41a2-93ff-d2559ba1fc78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1751 microversion: 2.20 time: 0.173685 Aug 17 11:26:15.099188 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 322/631] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:14 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:15.108041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:15.108527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:15.108954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:15.120309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] Creating event network-vif-deleted:4e8eeb5c-c626-4304-a2e4-c55bcee1bed8 for instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 on hv-cinder-85345 Aug 17 11:26:15.125266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-cf72f2a7-7e67-4537-82e9-e626bef20314 req-1b9f0dec-6148-4aa1-b6d5-b250887e2edc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Aug 17 11:26:15.125884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 310/632] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:26:15.516639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:15.517323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:15.524064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:15.524617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:15.525185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:15.526080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:15.526594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:15.527076 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:15.561618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:15.562387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:15.562851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:15.563358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lazy-loading 'fault' on Instance uuid 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:26:15.619659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:15.627597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a7975dbf-c907-4d1f-9422-10fb851180df tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 200 len: 1308 microversion: 2.1 time: 0.115025 Aug 17 11:26:15.628605 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 323/633] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:15 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:16.126567 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:16.127266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:16.133594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:16.134134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:16.134557 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:16.135245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:16.135742 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:16.136199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:16.327890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:16.336700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:16.338230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:16.339370 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-53517ed9-5c14-43c9-93c5-fc02ae88404c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1753 microversion: 2.20 time: 0.217808 Aug 17 11:26:16.339937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 311/634] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:16 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:26:16.654077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:16.655040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:16.667282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:16.668159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:16.668865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:16.670381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:16.671214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:16.672215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:16.694814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] HTTP exception thrown: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Request method failure captured: Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 HTTP/1.1 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M_UDDGTwRtSw6iHUrraH0urew3JdJiPXs2K7m7d5RINN0XLmFaI9anyn3DPVfwiT-1kS1IZOl9Jh9RSGBv0GelxW8MwwvajzNuOuSa9l4GEr64KeEoHk7RF8q_UYB17YWTJ237xUbGktYZhtt8AyOSPMfRocaKqMlTJiAVh_WxabwE Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 98b5f72e13f24093afcbafe833bd4324 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:26:16.696441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_98b5f72e13f24093afcbafe833bd4324", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 98b5f72e13f24093afcbafe833bd4324 Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-VolumesSnapshotTestJSON-1577098013-project Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: c8479873dd8a4a84a27dcd976a35f943 Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-VolumesSnapshotTestJSON-1577098013-project Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. Aug 17 11:26:16.698157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4'} Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:26:16.699183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. Aug 17 11:26:16.700799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:26:16.702281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Returning 404 to user: Instance 1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:26:16.702281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-203f6f1f-91f1-43f3-9cae-855d05a3aa5b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4" status: 404 len: 111 microversion: 2.1 time: 0.050453 Aug 17 11:26:16.702281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 324/635] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:16 2022] GET /compute/v2.1/servers/1065f3ea-ef30-4b9b-90d0-ce9bf31d11e4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:26:17.370354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:17.371691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:17.381512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:17.382242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:17.382884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:17.383919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:17.384601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:17.385231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:17.533373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:17.542226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:17.543747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:17.544891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e1b33c35-36bc-4ae4-96cb-a96841130bb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.185158 Aug 17 11:26:17.545447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 312/636] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:17 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:18.571054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:18.571857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:18.579479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:18.579942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:18.580385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:18.581074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:18.581528 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:18.582008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:18.772053 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:18.782448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:18.783936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:18.785085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-db8cea26-0911-431c-85a7-8fb1286674b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.220125 Aug 17 11:26:18.785721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 325/637] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:18 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:19.811598 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:19.812410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:19.821318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:19.821928 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:19.822450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:19.823303 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:19.823865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:19.824383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:19.968195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:19.976728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:19.978246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:19.979391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-be4e8be2-1651-49b2-a451-99c99a463367 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.173740 Aug 17 11:26:19.980116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 313/638] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:19 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:21.005677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:21.006682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:21.010630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=42 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:21.019479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:21.020402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:21.020973 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:21.022156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:21.022903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:21.023596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:21.168438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:21.181158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:21.183750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:21.185761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1832c554-98e6-4407-ba5f-b3f6b9bfbc12 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.186223 Aug 17 11:26:21.186299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 326/639] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:20 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:22.208129 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:22.209530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:22.218504 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:22.219416 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:22.220005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:22.220891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:22.221531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:22.222114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:22.227094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:22.440018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:22.449018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:22.450977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:22.452433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a8e2dca8-a57c-489c-bb74-f40d039193a5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.248278 Aug 17 11:26:22.467811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 314/640] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:22 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:23.476589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:23.478489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:23.487391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:23.488135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:23.488745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:23.489660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:23.490391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:23.490966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:23.651349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:23.660010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:23.661513 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:23.662656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-64cdebcb-9644-4d13-884d-9b28b56383fa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.190980 Aug 17 11:26:23.663212 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 327/641] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:23 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:24.688459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:24.689256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:24.696476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:24.696961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:24.697386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:24.698459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:24.699062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:24.699478 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:24.839829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:24.849120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:24.850646 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:24.851807 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bbcd09d7-db5e-4854-826b-f0dfa8d07268 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.170002 Aug 17 11:26:24.852745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 315/642] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:24 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:25.874850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:25.875460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:25.882462 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:25.882942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:25.883367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:25.884055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:25.884502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:25.884915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:26.020252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:26.029317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:26.030896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:26.032040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-04d0c27f-58ed-4e4e-9ac5-bb3601721708 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.161252 Aug 17 11:26:26.032595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 328/643] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:25 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:27.056893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:27.058306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:27.066382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:27.067135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:27.067737 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:27.068492 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:27.069494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:27.070110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:27.210222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:27.219943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:27.221501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:27.222608 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-26f441fc-881b-437f-a481-11c3a0229226 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.170852 Aug 17 11:26:27.223638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 316/644] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:27 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:28.363224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:28.363829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:28.369843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:28.370331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:28.370754 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:28.371446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:28.371891 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:28.372304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:28.437772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:26:28.438629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:26:28.514828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:28.523351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:28.524818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:28.525997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-aab79548-ce82-4cd8-ba8c-4660aecc3d81 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.281685 Aug 17 11:26:28.526551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 329/645] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:28 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:29.549046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:29.549686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:29.556622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:29.557114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:29.557584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:29.558277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:29.558734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:29.559152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:29.702397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:29.713870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:29.716174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:29.717468 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-42de48cc-defc-47f5-9805-4748e97bcccd tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.172406 Aug 17 11:26:29.718061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 317/646] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:29 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:30.741346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:30.741798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:30.748496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:30.750546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:30.750980 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:30.751668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:30.752112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:30.752525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:30.767846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:30.926551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:30.936691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:30.939097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:30.940840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8574affc-7a5d-4ff6-af79-87770b2ca016 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.203960 Aug 17 11:26:30.941637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 330/647] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:30 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:31.021810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1698472241", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "networks": [{"uuid": "4157a166-7d50-4b25-a72f-e9c8380b2d40"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:31.083484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] validate_networks() for [('4157a166-7d50-4b25-a72f-e9c8380b2d40', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:26:31.494770 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:26:31.495382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:26:31.496063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:26:31.496656 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:26:31.497288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:26:31.500301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:31.511573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:31.512294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:31.512871 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:31.514026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:31.514648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:31.515071 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:31.532356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Getting quotas for project 98b5f72e13f24093afcbafe833bd4324. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:26:31.536483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Getting quotas for user c8479873dd8a4a84a27dcd976a35f943 and project 98b5f72e13f24093afcbafe833bd4324. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:26:31.549022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:26:31.551363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:26:31.597593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-345edd4a-249e-4f0f-a1d4-5db66a4755d0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580288 Aug 17 11:26:31.598233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 318/648] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:26:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 11:26:31.609136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8afbfb81-f582-4f98-849c-834c937f84cc tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:31.609809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8afbfb81-f582-4f98-849c-834c937f84cc tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:31.667501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8afbfb81-f582-4f98-849c-834c937f84cc tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:31.676644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8afbfb81-f582-4f98-849c-834c937f84cc tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1219 microversion: 2.1 time: 0.071406 Aug 17 11:26:31.677194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 331/649] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:31 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:31.968308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:31.969916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:31.978519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:31.979358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:31.980026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:31.981170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:31.981913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:31.982618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:32.173948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:32.182982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:32.184483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:32.185672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cee713fa-30ef-43e2-9808-bb4ea81e68d8 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.225227 Aug 17 11:26:32.186278 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 319/650] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:31 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:32.698600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:32.699931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:32.706867 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:32.707608 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:32.708276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:32.709296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:32.709777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:32.710176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:32.772953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:32.781257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8398978e-fe9d-44b9-93e4-7bba15017564 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.087327 Aug 17 11:26:32.782233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 332/651] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:32 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:33.209083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:33.209719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:33.216484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:33.216967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:33.217436 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:33.218142 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:33.218621 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:33.219039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:33.353180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:33.365543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:33.367855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:33.369371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-89384782-07bc-42e4-98c5-d75cfc48c825 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.164335 Aug 17 11:26:33.370165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 320/652] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:33 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:33.804361 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:33.805711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:33.814622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:33.815274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:33.815862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:33.816885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:33.817557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:33.818203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:33.884795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:33.894277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-64e11565-3e98-4c00-9847-cd96d8d1d3f7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.094273 Aug 17 11:26:33.895175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 333/653] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:33 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:34.392582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:34.393347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:34.400203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:34.400682 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:34.401137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:34.401855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:34.402331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:34.402748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:34.537172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:34.547096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:34.548715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:34.549965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d1227755-2a83-4216-b605-8ab726a4c08d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.161414 Aug 17 11:26:34.550516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 321/654] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:34 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:34.920045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:34.921404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:34.929105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:34.929894 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:34.930424 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:34.931149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:34.931637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:34.932126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:34.993904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:35.003586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ee62f134-bfb8-4804-b8f1-4c990265ab3b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.092071 Aug 17 11:26:35.004653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 334/655] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:34 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:35.572976 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:35.573762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:35.580701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:35.581187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:35.581656 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:35.582360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:35.582814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:35.583211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:35.722645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:35.731357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:35.732863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:35.734103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-09deb237-56e0-473f-9ffb-7c92eb9de7f2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.165748 Aug 17 11:26:35.734671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 322/656] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:35 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:36.026179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:36.026910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:36.034004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:36.034757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:36.035210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:36.035919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:36.036502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:36.036919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:36.107338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:36.115143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-12e052fc-2a1d-42bd-a947-41f9b9e35da8 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.094558 Aug 17 11:26:36.115718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 335/657] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:36 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:36.761097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:36.762021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:36.772575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:36.773368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:36.774152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:36.775300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:36.776044 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:36.776693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:36.908433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:36.917965 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:36.919450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:36.920662 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-780fbe89-9899-4b11-916e-e1cdd61e6dcb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.166209 Aug 17 11:26:36.921233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 323/658] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:36 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:37.140004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:37.140806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:37.148803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:37.149371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:37.149926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:37.150783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:37.151314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:37.151812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:37.218753 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:37.226451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d1a4aeee-6fdc-42e2-8517-747480d3950f tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.093157 Aug 17 11:26:37.227017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 336/659] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:37 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:37.943655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:37.944612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:37.951505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:37.951993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:37.952514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:37.953202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:37.953694 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:37.954119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:38.091862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:38.101384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:38.103078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:38.104281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b31c8c77-0eeb-4b40-bc0b-11fd72c70365 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.164613 Aug 17 11:26:38.104858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 324/660] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:37 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:38.252541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:38.253350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:38.261600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:38.262245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:38.262809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:38.263713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:38.264333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:38.264860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:38.331138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:38.338790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-306efc10-c415-434b-9a04-bb0b6a9a760a tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1223 microversion: 2.1 time: 0.092199 Aug 17 11:26:38.339357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 337/661] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:38 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:39.129356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:39.130179 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:39.139637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:39.140326 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:39.140931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:39.141947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:39.142626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:39.143223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:39.282188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:39.290590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:39.292082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:39.293221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7b08064e-39ef-43d4-b772-5a66cdd520fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.169667 Aug 17 11:26:39.293817 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 325/662] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:39 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:39.362468 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:39.363202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:39.371934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:39.372547 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:39.373107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:39.374045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:39.374665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:39.375181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:39.438910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:39.446562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8f92d11d-d1a2-4f2c-a2f8-e111c1673673 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1215 microversion: 2.1 time: 0.090164 Aug 17 11:26:39.447117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 338/663] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:39 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:40.321216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:40.322089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:40.331954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:40.332459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:40.332887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:40.333618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:40.334070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:40.334819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:40.467568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:40.468020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:40.469971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:40.474694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:40.475164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:40.475585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:40.476272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:40.476722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:40.477166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:40.478626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:40.480135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:40.481371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7f84da58-1214-43bf-99a7-139b030ee216 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.167305 Aug 17 11:26:40.482132 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 326/664] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:40 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:40.540868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:40.548593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ebcf7e03-3203-4dc2-9fa8-f28c611b3b06 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1215 microversion: 2.1 time: 0.085088 Aug 17 11:26:40.549378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 339/665] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:40 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:41.504699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:41.505251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:41.513148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:41.513991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:41.514205 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:41.515167 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:41.515657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:41.516121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:41.531322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:41.547375 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:41.570890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:41.571492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:41.578662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:41.579098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:41.579802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:41.580609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:41.581235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:41.581741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:41.661520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:41.669098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5af9e622-aa07-4fcd-b24c-764567335c0b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1277 microversion: 2.1 time: 0.102522 Aug 17 11:26:41.669949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 340/666] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:41 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:26:41.686535 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:41.695617 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:41.697113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:41.698707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b037026b-825e-4070-b46a-357bc385638b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.198307 Aug 17 11:26:41.699272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 327/667] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:41 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:42.690767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:42.691457 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:42.694842 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:42.699179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:42.699681 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:42.700186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:42.700978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:42.701472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:42.701918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:42.722750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:42.724413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:42.732958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:42.733885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:42.734515 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:42.735581 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:42.736997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:42.738580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:42.912141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:42.921829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c7f4863b-d746-4b83-bcaf-fa679f7c83d5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.235033 Aug 17 11:26:42.923157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:42.931793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:42.932999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 341/668] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:42 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:42.933777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:42.935164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b17f650a-1d92-4b01-8b61-dff40981d1a4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.216821 Aug 17 11:26:42.935874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 328/669] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:42 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:42.938983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804dfc38-56a5-4b2c-8e57-06ed6d295bdb", "tag": "cc0f9f6e-102b-40c9-9cc3-b36430b93630"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:42.949340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:42.949918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:42.950511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:42.961534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] Creating event network-changed:cc0f9f6e-102b-40c9-9cc3-b36430b93630 for instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb on hv-cinder-85345 Aug 17 11:26:42.966528 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-50cb5b34-cc8d-43d1-ab98-2f6321049373 req-7a360671-3220-47e9-9c2d-9f6989b0f02e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032243 Aug 17 11:26:42.967114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 342/670] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:26:43.943093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:43.943703 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:43.950849 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:43.951331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:43.951761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:43.953252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:43.953795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:43.954215 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:43.959589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:43.960282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:43.966693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:43.967176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:43.967604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:43.968290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:43.968713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:43.969158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:44.152601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:44.160245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-617af386-b27a-43f1-a5c3-68e6941af1a7 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.221199 Aug 17 11:26:44.160418 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:44.160888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 329/671] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:43 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:44.169282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:44.170809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:44.171972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1ce0d967-9204-42e0-95e6-450f3b4f8c35 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.217158 Aug 17 11:26:44.172535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 343/672] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:43 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:45.184645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:45.185612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:45.194735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:45.195254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:45.195679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:45.195818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:45.196378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:45.196522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:45.196823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:45.197413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:45.203034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:45.203514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:45.203943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:45.204631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:45.205072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:45.205519 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:45.621443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:45.624616 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:45.629270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ad0268bc-57b7-4f6b-8443-b54cfd7a5d1e tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.451291 Aug 17 11:26:45.629930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 330/673] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:45 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:45.633642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:45.635151 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:45.636347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ee06042e-21a4-4336-9701-ad986bc815f9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.444651 Aug 17 11:26:45.637144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 344/674] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:45 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:46.654650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:46.655778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:46.662155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:46.662792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:46.663810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:46.664423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:46.664853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:46.665582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:46.666038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:46.666455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:46.669210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:46.669729 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:46.670123 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:46.671122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:46.671576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:46.671989 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:46.684340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=100 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:46.859324 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:46.862253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:46.867231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e39ad4fa-9275-4ae1-9499-55bbe1e22eac tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.219350 Aug 17 11:26:46.867803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 331/675] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:46 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:46.870794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:46.872260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:46.873432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1dbd74e3-43cf-4107-949d-8c5e29b0f75c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.216292 Aug 17 11:26:46.873969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 345/676] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:46 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:47.888042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:47.893107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:47.899947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:47.899947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:47.900384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:47.901152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:47.902335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:47.905717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:47.905980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:47.906410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:47.910297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:47.911010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:47.911620 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:47.912593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:47.913189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:47.913874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:48.107797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:48.111049 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:48.116346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:48.117979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:48.119146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4fb6e424-c702-47ac-905a-63ac74841034 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.223878 Aug 17 11:26:48.119735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 346/677] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:47 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:48.136141 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9ef510f5-4d76-4a9e-80c8-c728041405d4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.251844 Aug 17 11:26:48.136720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 332/678] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:47 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:49.145115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:49.145778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:49.153199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:49.153772 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:49.154244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:49.154998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:49.155491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:49.155945 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:49.156797 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:49.157479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:49.164573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:49.165249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:49.165771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:49.166528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:49.167028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:49.167486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:49.360058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:49.363270 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:49.370239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:49.370924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-57988600-fdbf-476a-ac55-003b1e92e4c5 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.218398 Aug 17 11:26:49.371738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:49.372930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-928a3c8f-4acf-453f-8823-213ac73117fe tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.233154 Aug 17 11:26:49.373479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 347/679] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:49 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:49.384447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 333/680] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:49 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:49.650443 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804dfc38-56a5-4b2c-8e57-06ed6d295bdb", "name": "network-vif-plugged", "status": "completed", "tag": "cc0f9f6e-102b-40c9-9cc3-b36430b93630"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:49.662331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:49.662848 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:49.663390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:49.674412 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] Creating event network-vif-plugged:cc0f9f6e-102b-40c9-9cc3-b36430b93630 for instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb on hv-cinder-85345 Aug 17 11:26:49.679648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-635bdb67-0bb5-4a6f-85e4-c305f11e9039 req-48512299-10c3-4259-96c2-7bc184da79cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Aug 17 11:26:49.680243 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 348/681] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:26:50.391982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:50.392691 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:50.396064 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:50.396739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:50.399697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:50.400252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:50.400746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:50.401570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:50.402079 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:50.402567 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:50.403507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:50.403980 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:50.404390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:50.405074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:50.405541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:50.406146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:50.420750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=100 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:50.596914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:50.601081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:50.608306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b2732f02-1c10-4792-b7f6-39411908a26b tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.220174 Aug 17 11:26:50.608947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 334/682] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:50 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:50.609580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:50.611065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:50.612303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-da53a5cc-663a-430d-93f7-572f1ce35604 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.220369 Aug 17 11:26:50.612855 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 349/683] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:50 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:51.628563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:51.629154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:51.634431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:51.635049 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:51.636391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:51.636884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:51.637317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:51.638115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:51.638569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:51.638990 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:51.640284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=50 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:51.642937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:51.644702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:51.644702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:51.645119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:51.645669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:51.646245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:51.843542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:51.847107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:51.851565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-55598ab8-da0e-4790-b1cf-bbddeb682baf tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1319 microversion: 2.1 time: 0.226905 Aug 17 11:26:51.852124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 335/684] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:51 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:51.856880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:51.858663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:51.859961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cb474d58-5bde-427a-97b7-b752cfc9a71b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.229323 Aug 17 11:26:51.860602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 350/685] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:51 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:51.865000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "name": "network-vif-plugged", "status": "completed", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:51.875392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:51.875868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:51.876481 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:51.890773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] Creating event network-vif-plugged:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:26:51.896014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-090783f7-a15b-4904-ae7f-703dbd7e3f74 req-ceb4f6e2-17b2-4de0-aace-c2b8d4b80c14 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034785 Aug 17 11:26:51.896623 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 336/686] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:26:52.886825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:52.888422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:52.890380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:52.891499 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:52.897640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:52.898076 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:52.898465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:52.898618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:52.898944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:52.899209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:52.899369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:52.899650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:52.900063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:52.900212 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:52.900494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:52.903341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:53.099888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:53.102955 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:53.108415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c010919f-f816-49ff-83be-1f57a414ac53 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1508 microversion: 2.1 time: 0.227237 Aug 17 11:26:53.109125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 337/687] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:52 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:53.112094 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:53.113595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:53.114778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-43cc77a5-145c-427a-87b0-7b6f826afbe3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.234526 Aug 17 11:26:53.115351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 351/688] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:52 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:53.129027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6ef52a-9cbe-434a-9410-2a9d52cd8ac1", "device": "/dev/sdb"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:53.132274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:53.138606 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:53.139040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:53.139467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:53.140168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:53.140620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:53.141038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:54.071109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ff9f4083-71b0-4435-8f2f-c17e45748709 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "POST /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945697 Aug 17 11:26:54.071799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 338/689] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:26:53 2022] POST /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:26:54.138376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:54.139484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:54.147265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:54.147736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:54.148164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:54.148859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:54.149294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:54.149742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:54.283146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:54.295753 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:54.297784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:54.299561 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6385e276-c371-4621-9af9-6c8ac1ea3627 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.165418 Aug 17 11:26:54.300231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 352/690] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:54 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:55.323777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:55.324519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:55.332095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:55.332566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:55.333005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:55.333754 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:55.334226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:55.334652 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:55.478949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:55.487792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:55.489328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:55.490490 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-94b68099-c643-4835-947a-cd28dd9539e9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1809 microversion: 2.20 time: 0.171546 Aug 17 11:26:55.491368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 339/691] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:55 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:56.519187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:56.520022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:56.526685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:56.527174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:56.527604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:56.528293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:56.528745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:56.529163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:56.667115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:56.676020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:56.677545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:56.678710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3e490355-9e77-4935-b0e1-ac8d598a5396 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1796 microversion: 2.20 time: 0.167056 Aug 17 11:26:56.679273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 353/692] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:26:56 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1796 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:26:57.366163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:26:57.368442 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:57.375282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:57.375760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:57.376175 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:57.376869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:57.377310 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:57.377773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:57.449917 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6e08be1a-ffa8-4e81-b6d4-ae51a692f3cb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action" status: 202 len: 0 microversion: 2.1 time: 0.087491 Aug 17 11:26:57.450546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 340/693] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:26:57 2022] POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:26:57.459735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:57.460347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:57.466602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:57.467208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:57.467693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:57.468540 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:57.469070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:57.469671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:57.624699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:57.633100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e7ec4b5c-6c4d-458d-bc48-6ce2a40ad4f6 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1752 microversion: 2.1 time: 0.178338 Aug 17 11:26:57.634919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 354/694] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:57 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:58.661041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:58.661843 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:58.669444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:58.670014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:58.670522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:58.671291 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:58.671851 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:58.672345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:58.818104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:26:58.826497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-17e4c5d2-edd9-47af-a459-4f1d62037de5 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.173067 Aug 17 11:26:58.827043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 341/695] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:58 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:26:59.854338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:26:59.855222 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:26:59.866031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:59.866814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:59.867517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:26:59.868635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:26:59.869376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:26:59.870104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:00.017282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:00.025443 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-88e86205-7e1c-41ba-acbe-c480b68f4128 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.177831 Aug 17 11:27:00.026249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 355/696] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:26:59 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:01.051058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:01.052058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:01.059421 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:01.059898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:01.060322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:01.061025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:01.061475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:01.061914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:01.214564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:01.223050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d43c696c-3f48-4c73-8452-986a03426d02 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.178522 Aug 17 11:27:01.223613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 342/697] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:01 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:02.248458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:02.249354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:02.259060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:02.259577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:02.260122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:02.260914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:02.261372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:02.261809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:02.408127 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:02.416235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-078d14ae-9785-41e2-b0dc-9bb2cfd1488a tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.174258 Aug 17 11:27:02.416803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 356/698] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:02 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:03.442006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:03.442993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:03.447364 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:03.456490 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:03.457316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:03.458037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:03.459161 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:03.459750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:03.460171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:03.614328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:03.624241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-80f3517d-f993-4f2d-ada1-8495312ad227 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.188916 Aug 17 11:27:03.624815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 343/699] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:03 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:04.649153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:04.649785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:04.657003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:04.657555 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:04.658005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:04.658725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:04.659199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:04.659651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:04.808235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:04.816504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f314009a-a533-4b5d-8e70-4f4f025f5552 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.173180 Aug 17 11:27:04.817096 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 357/700] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:04 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:05.842703 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:05.843816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:05.853339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:05.853882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:05.854309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:05.855000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:05.855489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:05.855931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:06.004201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:06.013015 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8c52f9ac-7107-42d9-9fed-9f28ababc605 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.177025 Aug 17 11:27:06.013653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 344/701] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:05 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:07.038544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:07.039784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:07.050666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:07.051461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:07.052174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:07.053384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:07.053905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:07.054323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:07.208361 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:07.216506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-59ee7645-ed09-4ebc-b88b-e93553cf079c tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.184733 Aug 17 11:27:07.217091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 358/702] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:07 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:08.239697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:08.239697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:08.246099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:08.246583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:08.247010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:08.247699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:08.248145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:08.248562 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:08.393118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:08.402801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1370c318-12a9-4d2e-86d4-003ec6c0b4fa tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.168490 Aug 17 11:27:08.403369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 345/703] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:08 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:09.429781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:09.430601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:09.438948 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:09.439551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:09.440092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:09.440966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:09.441607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:09.442131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:09.595333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:09.605069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5e7f937f-6fb4-4c24-8a96-1653067e26e8 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.181872 Aug 17 11:27:09.605677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 359/704] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:09 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:10.630379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:10.631466 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:10.638704 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:10.639202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:10.639650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:10.640371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:10.640838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:10.641276 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:10.659338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:10.786595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:10.794747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5038392a-9ca9-434f-81e4-1ef70ea86fed tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.170870 Aug 17 11:27:10.795320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 346/705] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:10 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:11.820183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:11.820801 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:11.827797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:11.828284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:11.828727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:11.829511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:11.829974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:11.830394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:11.984083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:11.996407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ccd6a069-af2a-4447-961b-eed40e745a21 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.182365 Aug 17 11:27:11.997139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 360/706] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:11 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:13.022494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:13.023186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:13.030780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:13.031317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:13.031792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:13.032552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:13.033054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:13.033543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:13.177665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:13.186012 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c1525728-9421-4b88-bae7-c0572e631dc2 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.170223 Aug 17 11:27:13.186760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 347/707] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:13 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:14.216815 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:14.217975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:14.227751 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:14.228225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:14.228650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:14.229332 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:14.229880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:14.230291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:14.376170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:14.384450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8b7a1869-80a6-43d4-89a0-80cd783cde1e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.174380 Aug 17 11:27:14.385022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 361/708] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:14 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:15.405310 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:15.405961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:15.413093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:15.413630 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:15.414059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:15.414765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:15.415217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:15.415628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:15.560462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:15.569543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b89c332a-d091-4371-84c8-55b905160c6f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.167599 Aug 17 11:27:15.570107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 348/709] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:15 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:16.590779 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:16.591373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:16.598552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:16.599022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:16.599445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:16.600103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:16.600614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:16.601026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:16.745339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:16.753715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b298610d-2601-487d-91f1-f23fa2e7a553 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.166668 Aug 17 11:27:16.754201 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 362/710] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:16 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:17.778892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:17.779901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:17.789833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:17.790317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:17.790749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:17.791434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:17.791892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:17.792310 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:17.943105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:17.951793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1ea136ac-f71e-4702-a108-e0675aa68144 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.179279 Aug 17 11:27:17.952362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 349/711] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:17 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:18.750089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:18.750601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:18.757273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:18.757792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:18.758268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:18.758953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:18.759399 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:18.759814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:18.845925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lazy-loading 'services' on Instance uuid 804dfc38-56a5-4b2c-8e57-06ed6d295bdb {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:27:18.920989 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-079def5e-d58c-4856-8368-8bc0779a1e91 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "DELETE /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb/os-volume_attachments/9b6ef52a-9cbe-434a-9410-2a9d52cd8ac1" status: 202 len: 0 microversion: 2.1 time: 0.174975 Aug 17 11:27:18.921637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 363/712] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:27:18 2022] DELETE /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb/os-volume_attachments/9b6ef52a-9cbe-434a-9410-2a9d52cd8ac1 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:27:19.030858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:19.031474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:19.038123 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:19.038611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:19.039043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:19.039741 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:19.040175 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:19.040597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:19.187015 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:19.195540 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-dae27e64-4c34-49d2-86bd-d62756b7edf7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1757 microversion: 2.1 time: 0.168523 Aug 17 11:27:19.196426 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 350/713] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:19 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:20.217531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:20.218248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:20.224787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:20.225263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:20.225736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:20.226461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:20.226909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:20.227332 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:20.380331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:20.394738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cf208bb6-58cd-4402-b6a3-93edf52ee0bb tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1760 microversion: 2.1 time: 0.181807 Aug 17 11:27:20.395502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 364/714] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:20 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:21.111247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:21.111781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:21.119951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:21.120414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:21.120844 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:21.121564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:21.122025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:21.122440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:21.147091 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:27:21.229530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-70bebd47-cedd-4140-9c50-527c6ab46708 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "DELETE /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 204 len: 0 microversion: 2.1 time: 0.123901 Aug 17 11:27:21.230556 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 351/715] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:27:21 2022] DELETE /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:27:21.240412 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:21.241016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:21.247531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:21.248008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:21.248431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:21.249109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:21.249589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:21.250034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:21.252638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:21.381979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:21.393058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-789b8065-7ba6-4cbf-8318-1d71801469c0 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1514 microversion: 2.1 time: 0.156644 Aug 17 11:27:21.393659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 365/716] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:21 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:22.421572 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:22.422787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:22.433983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:22.434787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:22.435497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:22.436632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:22.437380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:22.438422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:22.572338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:22.580500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-743903b7-cedb-49fa-81d5-7e5ae06deb57 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1514 microversion: 2.1 time: 0.166305 Aug 17 11:27:22.581065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 352/717] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:22 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:23.605863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:23.606878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:23.610512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=32 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:23.619103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:23.620015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:23.620445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:23.621128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:23.621610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:23.622031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:23.756128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:23.763862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5b659fef-9436-443b-8a5a-aaf51992ae25 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1514 microversion: 2.1 time: 0.164444 Aug 17 11:27:23.764442 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 366/718] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:23 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:24.784381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:24.785055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:24.791661 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:24.792277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:24.794283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:24.795950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:24.796910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:24.797339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:24.865366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804dfc38-56a5-4b2c-8e57-06ed6d295bdb", "name": "network-vif-deleted", "tag": "cc0f9f6e-102b-40c9-9cc3-b36430b93630"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:27:24.874971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:24.875441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:24.875862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:24.889614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] Creating event network-vif-deleted:cc0f9f6e-102b-40c9-9cc3-b36430b93630 for instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb on hv-cinder-85345 Aug 17 11:27:24.889810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8479873dd8a4a84a27dcd976a35f943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b5f72e13f24093afcbafe833bd4324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:24.893793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a9f40a9b-98b9-4164-a6dc-ab4968f5dba3 req-05e8ee22-dd95-47d5-a89a-d90b841eae15 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087690 Aug 17 11:27:24.897014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 367/719] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:27:24.898664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-23d00251-e41b-4f7e-a5ac-cec56167f3e4 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 200 len: 1472 microversion: 2.1 time: 0.118149 Aug 17 11:27:24.899209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 353/720] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:24 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:25.920083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:25.920731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] [instance: 804dfc38-56a5-4b2c-8e57-06ed6d295bdb] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:25.927371 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:25.927851 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:25.928283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:25.928969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:25.929403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:25.929860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:25.943327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] HTTP exception thrown: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Request method failure captured: Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb HTTP/1.1 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M_UDDGTwRtSw6iHUrraH0urew3JdJiPXs2K7m7d5RINN0XLmFaI9anyn3DPVfwiT-1kS1IZOl9Jh9RSGBv0GelxW8MwwvajzNuOuSa9l4GEr64KeEoHk7RF8q_UYB17YWTJ237xUbGktYZhtt8AyOSPMfRocaKqMlTJiAVh_WxabwE Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 98b5f72e13f24093afcbafe833bd4324 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:27:25.945264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/98b5f72e13f24093afcbafe833bd4324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_98b5f72e13f24093afcbafe833bd4324", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 98b5f72e13f24093afcbafe833bd4324 Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1577098013 Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-VolumesSnapshotTestJSON-1577098013-project Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: c8479873dd8a4a84a27dcd976a35f943 Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-VolumesSnapshotTestJSON-1577098013-project Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. Aug 17 11:27:25.946648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '804dfc38-56a5-4b2c-8e57-06ed6d295bdb'} Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:27:25.947516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. Aug 17 11:27:25.949198 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:27:25.950376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] Returning 404 to user: Instance 804dfc38-56a5-4b2c-8e57-06ed6d295bdb could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:27:25.950376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4b571bbe-b9d2-48fe-a64e-de32e3c494a9 tempest-VolumesSnapshotTestJSON-1577098013 tempest-VolumesSnapshotTestJSON-1577098013-project] 10.222.0.15 "GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb" status: 404 len: 111 microversion: 2.1 time: 0.030638 Aug 17 11:27:25.950376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 354/721] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:25 2022] GET /compute/v2.1/servers/804dfc38-56a5-4b2c-8e57-06ed6d295bdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:27:25.964408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7c5d745-c13e-4d39-b0fb-ae72c4589bf0"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:27:25.966813 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:25.973335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:25.973853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:25.974280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:25.975038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:25.975420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:25.975841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:26.264005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d630a61f-0399-4279-b6f4-3c0cbc2332a5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419933 Aug 17 11:27:26.264675 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 368/722] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:27:25 2022] POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:27:34.978812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:27:34.981124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:34.983857 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:34.989717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:34.990188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:34.990634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:34.991309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:34.991752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:34.992158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:35.018483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lazy-loading 'flavor' on Instance uuid 373351f7-7c12-4ae6-8a01-aec1209a3e5c {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:27:35.183231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-eac4ed0c-3cab-4471-9634-525c67f0e018 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/action" status: 200 len: 32 microversion: 2.1 time: 0.208340 Aug 17 11:27:35.183819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 355/723] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:27:34 2022] POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:27:35.195343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:35.196041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:35.202586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:35.203118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:35.203601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:35.204294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:35.204765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:35.205221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:35.267756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:27:35.267923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c (ip 10.222.0.15) !!! Aug 17 11:27:35.342548 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:35.351915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-01ed1305-4c08-4af2-bc82-092484177e2f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.162059 Aug 17 11:27:35.352695 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 369/724] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:35 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:36.374548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:36.375463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:36.386393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:36.387065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:36.387604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:36.388382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:36.388961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:36.389605 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:36.529167 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:36.540734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-63a4f5e6-0510-42f3-8651-a7b01bb493ad tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.171456 Aug 17 11:27:36.541683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 356/725] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:36 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:37.568370 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:37.569892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:37.580532 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:37.581375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:37.582145 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:37.583288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:37.584042 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:37.584742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:37.719713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:37.728053 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6abc2769-eb52-4359-be74-262162bf57a8 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.166356 Aug 17 11:27:37.728641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 370/726] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:37 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:38.756395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:38.757026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:38.764034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:38.764512 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:38.764942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:38.765663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:38.766256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:38.766708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:38.914104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:38.922275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d397a6c5-1856-471a-8b76-075b55ea4913 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.169865 Aug 17 11:27:38.922839 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 357/727] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:38 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:39.947787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:39.948795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:39.959746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:39.960597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:39.961362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:39.962606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:39.963325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:39.964022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:40.102147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:40.110445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-aa18aeb1-f23e-4d31-b6b5-7aebd740d98a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.169756 Aug 17 11:27:40.111018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 371/728] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:39 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:41.136301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:41.137277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:41.148222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:41.148931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:41.149721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:41.150858 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:41.151607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:41.152318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:41.156711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:41.298036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:41.306394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cbbf7d29-b99f-4181-809f-449ec1ec3677 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.176697 Aug 17 11:27:41.306960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 358/729] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:41 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:42.328261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:42.328924 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:42.335651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:42.336178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:42.336601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:42.337374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:42.337925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:42.338463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:42.477878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:42.485998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-50144ac0-3bf9-4e3d-83f3-fa3c941ea3f0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.162173 Aug 17 11:27:42.486570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 372/730] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:42 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:43.507545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:43.508201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:43.514432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:43.514966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:43.515422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:43.516109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:43.516890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:43.517217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:43.648998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:43.657053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f1f66637-21c1-4ea5-9c7a-3a1bea7f0051 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.153343 Aug 17 11:27:43.657647 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 359/731] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:43 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:44.678191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:44.678804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:44.685226 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:44.685755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:44.686225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:44.686913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:44.687363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:44.687774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:44.836025 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:44.844233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-187dbd62-5bcb-4811-bba3-f9401a404934 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.169939 Aug 17 11:27:44.844821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 373/732] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:44 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:45.868870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:45.869541 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:45.876779 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:45.877267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:45.877728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:45.878416 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:45.878872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:45.879295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:46.020480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:46.028845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4fd4e059-0e03-4fb4-8dbd-a8200efb1d79 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.164235 Aug 17 11:27:46.029410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 360/733] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:45 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:47.054905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:47.055920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:47.067061 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:47.067867 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:47.068294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:47.069326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:47.069798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:47.070241 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:47.210791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:47.219560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1ffb6457-fc41-4fa5-bd5c-508604660f51 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.171623 Aug 17 11:27:47.220138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 374/734] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:47 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:48.244681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:48.245631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:48.256091 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:48.256903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:48.257677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:48.258826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:48.259590 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:48.260289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:48.403161 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:48.411595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-da1f8c86-62c2-421c-a0c5-42bd983e21b1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.173791 Aug 17 11:27:48.412201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 361/735] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:48 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:49.438000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:49.439014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:49.447998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:49.448476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:49.448909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:49.449634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:49.450101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:49.450512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:49.594296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:49.603411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a434ba92-19ea-46fa-bbbc-f0ddca76b147 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.171936 Aug 17 11:27:49.604022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 375/736] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:49 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:50.629351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:50.630499 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:50.641148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:50.641854 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:50.642518 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:50.643576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:50.644273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:50.644918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:50.779054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:50.789474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d423e0fa-0e91-44df-a230-d20cb0d1ed95 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.166996 Aug 17 11:27:50.790072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 362/737] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:50 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:51.816236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:51.816948 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:51.824177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:51.824705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:51.825139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:51.825918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:51.826444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:51.826865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:51.829853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:51.963703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:51.971826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c054e546-f350-48d9-9f73-03136f7a0bb6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.159424 Aug 17 11:27:51.972432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 376/738] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:51 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:52.997717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:52.998752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:53.008815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:53.009293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:53.009749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:53.010430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:53.010878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:53.011288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:53.153136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:53.161600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d4e17d5d-a5ac-4985-aa52-4e7bf96648bc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.170509 Aug 17 11:27:53.162136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 363/739] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:52 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:54.185894 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:54.186694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:54.189900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=22 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:54.197147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:54.197657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:54.198113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:54.198797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:54.199242 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:54.199651 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:54.337459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:54.345819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-82926784-e029-4bee-8a1a-5136e4f59786 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1735 microversion: 2.1 time: 0.165420 Aug 17 11:27:54.346391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 377/740] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:54 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:55.368736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:55.369463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:55.377221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.377857 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.378335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.379135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.379676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.380169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.519081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:55.527674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0af5d6d6-a40f-4e5c-90e4-c7bd2662e06e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1715 microversion: 2.1 time: 0.163691 Aug 17 11:27:55.528262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 364/741] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:55 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:55.641342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:55.641878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:55.648510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.648997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.649458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.650175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.650610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.651085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.731306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] HTTP exception thrown: Cannot 'detach_volume' instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c while it is in vm_state rescued Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Request method failure captured: Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments/a7c5d745-c13e-4d39-b0fb-ae72c4589bf0 HTTP/1.1 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8xQsP11rqoHSeqYadoRVeDEYhp-4efQLBtYZ9ExNFk7m0a63FVlWNxjOovefVWXJCcfgx7dmg8VkIZPNKffCwErdnV6CxJIx2SVb6bGfPUP5ckg8D2etpmBFaTnuAdFGJ_9g-sJoNGDR5WPjEkaxTAahOxiWBxfx2fE6RaOSQZwJI Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:27:55.732919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56b9f381040f4998bfaf4fc07a995380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: b5b61f023e1a403da575d83027e777ee Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:27:55.734415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Cannot 'detach_volume' instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c while it is in vm_state rescued Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'server_id': '373351f7-7c12-4ae6-8a01-aec1209a3e5c', 'id': 'a7c5d745-c13e-4d39-b0fb-ae72c4589bf0'} Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:27:55.735186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c while it is in vm_state rescued Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c while it is in vm_state rescued Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:27:55.737118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Returning 409 to user: Cannot 'detach_volume' instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c while it is in vm_state rescued {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:27:55.739077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8ab967c1-2cc8-4e28-9c21-f35972bf79c7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments/a7c5d745-c13e-4d39-b0fb-ae72c4589bf0" status: 409 len: 152 microversion: 2.1 time: 0.097137 Aug 17 11:27:55.739077 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 378/742] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:27:55 2022] DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments/a7c5d745-c13e-4d39-b0fb-ae72c4589bf0 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 11:27:55.747474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:27:55.748254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:55.756663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.757446 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.758095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.758927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.759382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.759800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.830435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d3023374-be5b-46cc-b65f-a88b7d06b83c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.089319 Aug 17 11:27:55.831157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 365/743] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:27:55 2022] POST /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:27:55.839501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:55.840198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:55.847459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.847981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.848755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.849618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:55.850380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:55.850877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:55.982591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:55.990736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2fa2ba7e-136a-43c2-89ac-c9ea2bd2cce6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1723 microversion: 2.1 time: 0.155074 Aug 17 11:27:55.991298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 379/744] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:55 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:57.018263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:57.019415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:57.027821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:57.028302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:57.028738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:57.029447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:57.029907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:57.030333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:57.161088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:57.169262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-184da36b-baab-4824-af0e-434839d91bf9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1723 microversion: 2.1 time: 0.159171 Aug 17 11:27:57.170015 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 366/745] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:57 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:58.192805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:58.193969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:58.202473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:58.203119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:58.203698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:58.204648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:58.205251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:58.205850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:58.337824 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:58.345941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5de95ec8-cf52-4072-bd78-e589c262902e tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1723 microversion: 2.1 time: 0.158414 Aug 17 11:27:58.346532 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 380/746] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:58 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:27:59.370804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:27:59.371487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:27:59.378384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:59.378870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:59.379302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:59.379992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:27:59.380441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:27:59.380867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:27:59.515237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:27:59.524049 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0abdfe66-a249-4b91-862f-b17ca931ea44 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1723 microversion: 2.1 time: 0.157965 Aug 17 11:27:59.524630 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 367/747] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:27:59 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:00.549912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:00.550894 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:00.561722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:00.562509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:00.563227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:00.564346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:00.565093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:00.565885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:00.721880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:00.732080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b23c8e78-d8ec-4e4e-99c2-72c84f4dc356 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1729 microversion: 2.1 time: 0.189033 Aug 17 11:28:00.732650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 381/748] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:00 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:00.754414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:00.754997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:00.761978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:00.762461 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:00.762894 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:00.763587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:00.764038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:00.764460 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:00.849821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3a52bfa4-2ead-41b8-9d3e-705d7ddf2389 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099211 Aug 17 11:28:00.850441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 368/749] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:28:00 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:02.109454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:02.119407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:02.119897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:02.120319 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:02.131950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] Creating event network-changed:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:28:02.137081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-dcf93d8c-1d0b-4f4e-9e82-a37bc6109958 req-cc1f1518-047e-4647-800d-f53b92e1824c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161534 Aug 17 11:28:02.137745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 382/750] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:04.153158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:04.162980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:04.163452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:04.163875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:04.175128 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] Creating event network-changed:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:28:04.180286 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-608a9cd4-4317-466c-a43f-a1837da24cf7 req-a26a1378-b5d7-4077-9934-b8f7083d5e69 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Aug 17 11:28:04.181004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 369/751] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:06.234514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:28:06.235351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:28:16.098176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=11 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:16.099001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=37 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:16.105240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:16.106060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:16.115294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.115934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.116510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.117447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.118033 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.118625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.149385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-17e03b87-29b6-42ca-bfec-254c2e15aae5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments/c17b6411-d3ce-44c0-8c70-bca7693f6ffb" status: 200 len: 194 microversion: 2.20 time: 0.053385 Aug 17 11:28:16.149993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 383/752] 10.222.0.15 () {60 vars in 1454 bytes} [Wed Aug 17 11:28:16 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments/c17b6411-d3ce-44c0-8c70-bca7693f6ffb => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:28:16.219250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=29 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:16.220606 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:16.225235 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:16.225847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:16.233261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.233818 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.234253 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.234939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.235420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.235842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.371148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lazy-loading 'services' on Instance uuid 76d1fb89-3bae-4f78-945d-175311eae82e {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:28:16.500398 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7664f3c5-b6e6-4b82-99ba-6439bc5401ee tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments/c17b6411-d3ce-44c0-8c70-bca7693f6ffb" status: 202 len: 0 microversion: 2.20 time: 0.283537 Aug 17 11:28:16.500967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 370/753] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 11:28:16 2022] DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments/c17b6411-d3ce-44c0-8c70-bca7693f6ffb => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:28:16.511149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:16.513569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:16.520371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.520950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.521449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.523219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:16.523901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:16.524726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:16.555504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c72f2212-64b3-4ec0-bf4e-6e4535f0391c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048458 Aug 17 11:28:16.556051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 384/754] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 11:28:16 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:28:17.569985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:17.572279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:17.579426 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.579905 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.580337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.581028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.581458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.581909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.610664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8142fa87-7aa8-4af1-85a6-a7793662f04d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045889 Aug 17 11:28:17.611528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 371/755] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 11:28:17 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:17.671288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:17.671818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:17.678255 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.678733 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.679161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.679840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.680291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.680702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.706816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:28:17.794138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0b684114-25de-49de-a49c-f61a2c085174 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 204 len: 0 microversion: 2.20 time: 0.126403 Aug 17 11:28:17.794626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 385/756] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 11:28:17 2022] DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 11:28:17.805322 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:17.806231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:17.814554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.815032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.815457 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.816130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:17.816577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:17.816989 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:17.955022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:17.963369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:17.964862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:17.966057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0deac065-e105-419c-a0b9-a3c29fb23058 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.166567 Aug 17 11:28:17.966664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 372/757] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:17 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:18.989019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:18.989757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:18.996438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:18.996923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:18.997340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:18.998186 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:18.998629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:18.999052 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:19.144337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:19.152514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:19.153966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:19.155120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-04341687-fef6-407b-8ed2-a876ea9239ae tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.170584 Aug 17 11:28:19.155647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 386/758] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:18 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:20.177941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:20.178525 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:20.185309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:20.185820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:20.186247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:20.186934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:20.187377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:20.187792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:20.316819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:20.325579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:20.327088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:20.328233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6edd45e8-589f-40f9-b888-6691c09593c3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1724 microversion: 2.20 time: 0.154442 Aug 17 11:28:20.329065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 373/759] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:20 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:20.962895 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d1fb89-3bae-4f78-945d-175311eae82e", "name": "network-vif-deleted", "tag": "cf729b92-fa15-4d2c-b4b9-33a340d9a455"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:20.973314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:20.973903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:20.974373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:20.986108 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] Creating event network-vif-deleted:cf729b92-fa15-4d2c-b4b9-33a340d9a455 for instance 76d1fb89-3bae-4f78-945d-175311eae82e on hv-cinder-85345 Aug 17 11:28:20.991057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-bc330b65-d2a9-455b-bcc2-f9f9f7a9612a req-ad94a406-9700-454c-879a-2be0f4cb8a82 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Aug 17 11:28:20.992216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 387/760] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:21.351888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:21.352480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:21.359515 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:21.360003 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:21.360439 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:21.361137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:21.361625 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:21.362046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:21.394431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:21.394921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:21.395350 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:21.395798 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lazy-loading 'fault' on Instance uuid 76d1fb89-3bae-4f78-945d-175311eae82e {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:28:21.440984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:21.449345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:21.450869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:21.452027 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-58a10e1f-bd6e-45e2-a0dd-7bb8193d62aa tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 200 len: 1372 microversion: 2.20 time: 0.104284 Aug 17 11:28:21.452797 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 374/761] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:21 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:22.475949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:22.476652 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:22.483221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:22.483701 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:22.484137 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:22.484827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:22.485276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:22.485839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:22.499441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e HTTP/1.1 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:28:22.501110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:28:22.502870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '76d1fb89-3bae-4f78-945d-175311eae82e'} Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:28:22.503689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:28:22.504997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:22.507566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:28:22.507566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0eccd59a-41e3-442d-b980-6a782e39f7ab tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 404 len: 111 microversion: 2.20 time: 0.031422 Aug 17 11:28:22.507566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 388/762] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:22 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:28:22.511593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3831edd2-1ebc-4108-a38e-3356c75f149b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '.version_select at 0x7f903f784550>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:22.539037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3831edd2-1ebc-4108-a38e-3356c75f149b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086997901" status: 204 len: 0 microversion: 2.20 time: 0.031151 Aug 17 11:28:22.539634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 375/763] 10.222.0.15 () {60 vars in 1262 bytes} [Wed Aug 17 11:28:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086997901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 11:28:23.202068 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-85482a59-fe9f-4314-89ae-3945253e375b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: .version_select at 0x7f90481f00d0>, body: {"keypair": {"name": "tempest-keypair-1542589504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPLLU6dbZ22adlBIQKc9lMuP0g9o9Sa1ZCD3FaxUurJ1rbkKpcJpnfTTTvtjjBUjbtwFBKXJ6RuShB0HUFlPmest8QdnBnyAVW6QSbLLbV27tWd915zalP6nK6jOhTgfw=="}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:23.217402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-85482a59-fe9f-4314-89ae-3945253e375b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for project e247a3ec0a244abf9d11299cc53b9311. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:28:23.221446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-85482a59-fe9f-4314-89ae-3945253e375b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for user 1e6765845c4c4960bfee00c6384e8a4b and project e247a3ec0a244abf9d11299cc53b9311. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:28:23.251609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-85482a59-fe9f-4314-89ae-3945253e375b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053536 Aug 17 11:28:23.252382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 389/764] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 11:28:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 11:28:24.282261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1471192140"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:24.282890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:24.289310 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:24.289847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:24.290261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:24.290960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:24.291378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:24.291789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:24.474099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.network.security_group_api [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Removing security group 4663383f-0f62-4f30-bf80-4d32e703e48e from port 005c32c2-bb33-4a13-8ab3-524199fd3cbd Aug 17 11:28:24.517316 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1521705513", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43691234-0e70-4705-a16e-85460708cc3e"}], "security_groups": [{"name": "tempest-securitygroup--1414893650"}], "key_name": "tempest-keypair-1542589504", "user_data": "}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:24.664677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] validate_networks() for [('43691234-0e70-4705-a16e-85460708cc3e', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:28:24.950923 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8d50696f-95f5-421a-b85b-a0cf00917127 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action" status: 202 len: 0 microversion: 2.1 time: 0.779456 Aug 17 11:28:24.951862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 376/765] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:28:24 2022] POST /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:28:24.961693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:24.992902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:24.993702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:24.994315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:25.019115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] Creating event network-changed:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:28:25.028731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-5951c0e4-d36a-4b76-9838-929ed8cbedae req-61301362-b5f8-4487-9716-208bf375c156 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069715 Aug 17 11:28:25.030952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 377/766] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:25.316196 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:28:25.316691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:28:25.317289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:28:25.317782 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:28:25.318559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:28:25.334286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:25.337661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:25.338579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:25.340470 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:25.340996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:25.341522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:25.358325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for project e247a3ec0a244abf9d11299cc53b9311. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:28:25.362432 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Getting quotas for user 1e6765845c4c4960bfee00c6384e8a4b and project e247a3ec0a244abf9d11299cc53b9311. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:28:25.373344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:28:25.375879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:28:25.423926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8fa56651-ce0e-438e-8969-8acc6312df71 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.911299 Aug 17 11:28:25.424739 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 390/767] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 11:28:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 17 11:28:25.436493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:25.437392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:25.492915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:25.501081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:25.502743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:25.504017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a4e5dbe6-b917-4ce9-8cc2-4071e5a125bb tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1282 microversion: 2.20 time: 0.072232 Aug 17 11:28:25.504645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 378/768] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:25 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:26.407357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:26.408781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:26.411057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:26.417044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.417571 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.418013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.418722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.419293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.419588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.426023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.426814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.427463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.439670 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] Creating event network-changed:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:28:26.446048 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-01f4768e-c3f0-4696-8125-d2f05efebe3a req-f7e50067-5667-4e7d-a054-547272feaf85 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039150 Aug 17 11:28:26.447359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 379/769] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:26.503670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lazy-loading 'services' on Instance uuid 403ff508-9ead-4eb0-bb87-8a45db2995d1 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:28:26.527096 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:26.528065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:26.535651 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.535938 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.536362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.537729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.538341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.539125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.609547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:26.633869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:26.635331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:26.638194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-28b64364-02d9-454f-aa1c-c2175a439c75 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments/c5416338-8615-4d3b-924a-9340bddadf12" status: 202 len: 0 microversion: 2.1 time: 0.235500 Aug 17 11:28:26.641557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 391/770] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:28:26 2022] DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments/c5416338-8615-4d3b-924a-9340bddadf12 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:28:26.647428 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b8a4dea5-8e9c-4b8a-86dc-5b3f6f4f6662 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1342 microversion: 2.20 time: 0.119926 Aug 17 11:28:26.648415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 380/771] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:26 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1342 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:28:26.650124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:26.653160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:26.661063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.661582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.662013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.663142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:26.663834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:26.664260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:26.719470 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5a9337fd-e811-4bb9-94d6-37cafee7336d tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074902 Aug 17 11:28:26.725166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 392/772] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:28:26 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:27.671352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:27.671927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:27.678901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:27.679384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:27.679819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:27.680503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:27.680949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:27.681398 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:27.732520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:27.735524 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:27.743376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:27.744132 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:27.744565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:27.745302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:27.745775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:27.746374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:27.771257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:27.778434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f8a54fc5-5570-4ac9-8db7-3e1b31ed16a7 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049763 Aug 17 11:28:27.779005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 393/773] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:28:27 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:27.780205 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:27.781714 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:27.782845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-325be9c4-71f2-42c8-aa52-c728ae7d4c3c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1340 microversion: 2.20 time: 0.116031 Aug 17 11:28:27.783789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 381/774] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:27 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:28.791090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:28.793267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:28.800051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.800542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.801080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.801770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.802208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.802972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.804911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:28.806031 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:28.812780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.813254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.813792 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.814686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.815112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.815701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.836041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-59fc561b-e601-4782-869d-65aafdbe4daf tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048969 Aug 17 11:28:28.837315 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 394/775] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:28:28 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:28:28.851856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:28.852700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:28.858865 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.859356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.859787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.860737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:28.861195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:28.861807 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:28.948004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] HTTP exception thrown: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 is not attached to volume c5416338-8615-4d3b-924a-9340bddadf12 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Request method failure captured: Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments/c5416338-8615-4d3b-924a-9340bddadf12 HTTP/1.1 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-f-uVxmdRtAMnqfQFarOqHM-8hiNi8xsjUY5BqU8NAFN-KYbfvfYeu6CXYDdSVKgQyjxpLiiuq_S9BR9IllnPYVNdEYL8KBexvzs2VX-esqOkXTrn0V90m-XFrAKoDpdqdusqsMz7HrgGj8Na73CT_59enc7WkZGKEDyK2MiabjfI Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 094318249c064c24a6caa73e916ed6eb Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:28:28.954903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_094318249c064c24a6caa73e916ed6eb", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 094318249c064c24a6caa73e916ed6eb Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-TestMinimumBasicScenario-1842974915-project Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: c8952da31e954c839be8ec8f6cd548a0 Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-TestMinimumBasicScenario-1842974915-project Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:28:28.956556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 is not attached to volume c5416338-8615-4d3b-924a-9340bddadf12 Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'server_id': '403ff508-9ead-4eb0-bb87-8a45db2995d1', 'id': 'c5416338-8615-4d3b-924a-9340bddadf12'} Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c5416338-8615-4d3b-924a-9340bddadf12. Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:28:28.961191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 is not attached to volume c5416338-8615-4d3b-924a-9340bddadf12 Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 is not attached to volume c5416338-8615-4d3b-924a-9340bddadf12 Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:28.962569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Returning 404 to user: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 is not attached to volume c5416338-8615-4d3b-924a-9340bddadf12 {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:28:28.963717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2d7af6a4-9658-48b0-8911-d448c54a80ca tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments/c5416338-8615-4d3b-924a-9340bddadf12" status: 404 len: 154 microversion: 2.1 time: 0.108576 Aug 17 11:28:28.963717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 395/776] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:28:28 2022] DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1/os-volume_attachments/c5416338-8615-4d3b-924a-9340bddadf12 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:28:28.975321 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:28.985221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:28.987275 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:28.988568 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d3ed055c-72a5-4f0b-8403-76f2d77f3812 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.187853 Aug 17 11:28:28.989075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 382/777] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:28 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:28:29.037344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:29.046872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:29.047335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:29.047934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:29.061621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] Creating event network-changed:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:28:29.067538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-b02e8f43-d322-4174-9b22-3cfb0735b3b1 req-7c4d8065-c0bf-484c-9846-77c042a08068 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033751 Aug 17 11:28:29.068907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 396/778] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:30.013817 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:30.014424 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:30.021199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.021687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.022104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.022798 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.023256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.023677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.119589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:30.120175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:30.126302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.126831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.127261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.128170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.128645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.129182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.155195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:28:30.161470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:30.169724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:30.171204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:30.172301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-348638eb-8336-4461-ae8b-ebbf756e9c00 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.162509 Aug 17 11:28:30.172861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 383/779] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:30 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:30.233382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8e5abb6d-bfea-4c3a-b88f-2cb1b1ce9a3f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 204 len: 0 microversion: 2.1 time: 0.118107 Aug 17 11:28:30.234045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 397/780] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:28:30 2022] DELETE /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:28:30.242378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:30.242995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:30.248899 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.249369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.249833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.250509 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:30.250956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:30.251366 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:30.383985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:30.391913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-af2334fa-9c56-4a29-a76d-31ec897e820e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1554 microversion: 2.1 time: 0.153193 Aug 17 11:28:30.392519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 384/781] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:30 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:31.200572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:31.201606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:31.212305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:31.213102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:31.213875 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:31.215005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:31.215759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:31.216464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:31.351415 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:31.359409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:31.360903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:31.362082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-911c7d61-6715-4762-920d-085e5d87bb55 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.169243 Aug 17 11:28:31.362650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 398/782] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:31 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:31.413258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:31.413920 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:31.420463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:31.420936 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:31.421358 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:31.422082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:31.422523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:31.422935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:31.570677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:31.581996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c1925d86-24a4-443c-858b-cd711c7b3462 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1554 microversion: 2.1 time: 0.172584 Aug 17 11:28:31.582603 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 385/783] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:31 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:32.384536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:32.385174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:32.391537 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:32.392036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:32.392511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:32.393195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:32.393685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:32.394101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:32.398230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:32.530872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:32.539429 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:32.540913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:32.542059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-99ebf63b-4541-4d59-9ffe-7af9ad96ba8f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.161657 Aug 17 11:28:32.542708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 399/784] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:32 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:32.607604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:32.608644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:32.619618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:32.620434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:32.621159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:32.622342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:32.623139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:32.623795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:32.759670 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:32.772000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-83e0d0d3-dbe2-4ac0-a692-f0d148a5e490 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1554 microversion: 2.1 time: 0.170649 Aug 17 11:28:32.772784 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 386/785] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:32 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:33.567670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:33.568721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:33.577030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:33.577717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:33.578216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:33.579105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:33.579667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:33.580190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:33.724686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:33.733146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:33.734676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:33.735769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c2916dfb-5c28-48d3-8443-bff52d79e43f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.174055 Aug 17 11:28:33.736330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 400/786] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:33 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:33.793515 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:33.794080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:33.800942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:33.801448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:33.801887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:33.802574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:33.803025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:33.803446 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:33.934077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:33.941636 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3f0c14ce-1c32-4884-9c1b-e151e8ac885e tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1554 microversion: 2.1 time: 0.151972 Aug 17 11:28:33.942223 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 387/787] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:33 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:34.758364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:34.759078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:34.765862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:34.766469 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:34.766972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:34.767680 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:34.768111 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:34.768536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:34.910112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:34.918385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:34.919896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:34.920991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a99e9080-4757-40f9-8c1f-72029cbe80af tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.166613 Aug 17 11:28:34.921890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 401/788] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:34 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:34.962997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:34.964117 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:34.971379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:34.971868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:34.972305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:34.973021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:34.973498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:34.973925 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:35.105016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8952da31e954c839be8ec8f6cd548a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094318249c064c24a6caa73e916ed6eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:35.112763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-43a502ae-60a3-4a50-83f0-576187b55001 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 200 len: 1554 microversion: 2.1 time: 0.153650 Aug 17 11:28:35.113330 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 388/789] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:34 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:35.418041 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403ff508-9ead-4eb0-bb87-8a45db2995d1", "name": "network-vif-deleted", "tag": "005c32c2-bb33-4a13-8ab3-524199fd3cbd"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:35.422829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:35.423493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=10 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:35.430029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:35.430522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:35.430952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:35.442346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] Creating event network-vif-deleted:005c32c2-bb33-4a13-8ab3-524199fd3cbd for instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 on hv-cinder-85345 Aug 17 11:28:35.447424 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-63d84c83-dd11-4de0-b900-79b49497bf6c req-b818831c-4919-4738-92f1-4627ee145089 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Aug 17 11:28:35.448004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 402/790] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:35.943785 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:35.944399 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:35.946434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:35.952790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:35.953274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:35.953780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:35.954482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:35.954934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:35.955459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:35.959686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:36.091832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:36.100133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:36.101628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:36.102731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fc18be6c-4082-40ff-83e4-f5ce817dbb84 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.163262 Aug 17 11:28:36.103325 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 389/791] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:35 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:36.134692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:36.135391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] [instance: 403ff508-9ead-4eb0-bb87-8a45db2995d1] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:36.141872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:36.142379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:36.142880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:36.143569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:36.144017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:36.144467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:36.160802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] HTTP exception thrown: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Request method failure captured: Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 HTTP/1.1 Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M-f-uVxmdRtAMnqfQFarOqHM-8hiNi8xsjUY5BqU8NAFN-KYbfvfYeu6CXYDdSVKgQyjxpLiiuq_S9BR9IllnPYVNdEYL8KBexvzs2VX-esqOkXTrn0V90m-XFrAKoDpdqdusqsMz7HrgGj8Na73CT_59enc7WkZGKEDyK2MiabjfI Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 094318249c064c24a6caa73e916ed6eb Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:28:36.162570 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/094318249c064c24a6caa73e916ed6eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_094318249c064c24a6caa73e916ed6eb", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 094318249c064c24a6caa73e916ed6eb Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842974915 Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-TestMinimumBasicScenario-1842974915-project Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: c8952da31e954c839be8ec8f6cd548a0 Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-TestMinimumBasicScenario-1842974915-project Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. Aug 17 11:28:36.164117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '403ff508-9ead-4eb0-bb87-8a45db2995d1'} Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:28:36.165016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. Aug 17 11:28:36.166535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:28:36.167892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Returning 404 to user: Instance 403ff508-9ead-4eb0-bb87-8a45db2995d1 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:28:36.167892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5de13b1f-81c7-4972-8bf0-7f99e2b665f3 tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1" status: 404 len: 111 microversion: 2.1 time: 0.034831 Aug 17 11:28:36.167892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 403/792] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:36 2022] GET /compute/v2.1/servers/403ff508-9ead-4eb0-bb87-8a45db2995d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:28:36.174861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7ce2f20c-06cc-41b8-9d6e-325696b71b0f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] Calling method '.version_select at 0x7f9044038430>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:36.196985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7ce2f20c-06cc-41b8-9d6e-325696b71b0f tempest-TestMinimumBasicScenario-1842974915 tempest-TestMinimumBasicScenario-1842974915-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1978109791" status: 202 len: 0 microversion: 2.1 time: 0.026163 Aug 17 11:28:36.197771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 390/793] 10.222.0.15 () {58 vars in 1272 bytes} [Wed Aug 17 11:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1978109791 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:28:36.304549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "name": "network-vif-plugged", "status": "completed", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:36.314119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:36.314787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:36.315430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:36.335425 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] Creating event network-vif-plugged:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:28:36.340371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-6094a8fe-1406-4872-a67e-6210d0509bd0 req-bfc9d82e-3036-4981-b9af-026a22326b33 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100461 Aug 17 11:28:36.341116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 404/794] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:37.126620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:37.127311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:37.134370 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.134857 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.135288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.135995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.136431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.136878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.217228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:37.217856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:37.224085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.224557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.224985 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.225694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.226139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.226535 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.248932 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lazy-loading 'flavor' on Instance uuid 320e37a2-baf8-4abc-b621-77f4516606ae {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:28:37.325843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-980f5835-9b1b-4412-b5a5-d47652a9c825 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "POST /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae/action" status: 202 len: 0 microversion: 2.1 time: 0.113239 Aug 17 11:28:37.326434 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 405/795] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:28:37 2022] POST /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 11:28:37.334946 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:37.335624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:37.341731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.342209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.342624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.343304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:37.343744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:37.344152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:37.344293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:37.353056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:37.355732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:37.356876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b4ec5e4d-570e-4047-8383-98d1343b1d27 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.234321 Aug 17 11:28:37.357874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 391/796] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:37 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:37.574875 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:37.583562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7e219775-dabd-44f1-b3d5-74dc2a0e02eb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.252575 Aug 17 11:28:37.584141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 406/797] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:37 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:28:38.379430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:38.380074 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:38.387241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:38.387395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:38.387760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:38.388470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:38.388941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:38.389351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:38.607156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:38.607889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:38.614525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:38.615003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:38.615458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:38.616176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:38.616617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:38.617029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:38.619061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:38.628279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:38.629775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:38.631084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9a17cd53-8e10-4d08-bc5a-8794435859ea tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1408 microversion: 2.20 time: 0.255626 Aug 17 11:28:38.632373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 392/798] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:38 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:38.829045 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:38.837387 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-20462265-3bf0-4b09-b27b-937d0243e32d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.234947 Aug 17 11:28:38.841476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 407/799] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:38 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:39.654410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:39.655002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:39.662318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.662811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.663283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:39.663999 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.664454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.664885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:39.820620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:39.828714 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:39.830717 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:39.832164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b675f0be-3b7a-4f83-8d1f-19d2f7486988 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1601 microversion: 2.20 time: 0.181921 Aug 17 11:28:39.839497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 393/800] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:28:39 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:28:39.855304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:39.855806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:39.859320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:39.859969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:39.862392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.862870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.863287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:39.863991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.864394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.865017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:39.866129 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.866469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.866862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:39.867547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:39.868188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:39.868592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:40.003897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-88803dc8-67df-4a42-bb17-31a6ee01b9f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152381 Aug 17 11:28:40.004594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 408/801] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 11:28:39 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:28:40.103176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:40.112266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ef65a8cb-9c07-493b-b14f-987cfc140aac tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.256640 Aug 17 11:28:40.113772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 394/802] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:39 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:28:41.113273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:41.124364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:41.125182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:41.125967 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:41.135243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:41.136500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:41.140515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] Creating event network-changed:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:28:41.145994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:41.146889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:41.147648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a21a959d-2093-4b81-b034-3adf04f9c75b req-a4a856c6-27db-4340-a4c1-41097b88f5ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038115 Aug 17 11:28:41.147837 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:41.148733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:41.148919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 409/803] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:41.150432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:41.152105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:41.296686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:41.308289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2af86d93-31cb-45b5-9298-509791830139 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.177265 Aug 17 11:28:41.309230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 395/804] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:41 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:42.332378 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:42.333158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:42.341068 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:42.341721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:42.342229 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:42.343007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:42.343527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:42.344015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:42.479193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:42.487106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b3ed4008-8676-4d14-af2f-8f02ad6b32a7 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.159891 Aug 17 11:28:42.487663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 410/805] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:42 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:43.509048 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:43.509698 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:43.517033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:43.517687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:43.518489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:43.519328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:43.519840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:43.520262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:43.661070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:43.668731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4b03d920-da37-49d5-98c3-b171f2b406a5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.164010 Aug 17 11:28:43.669301 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 396/806] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:43 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:44.690167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:44.691604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:44.704407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:44.704950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:44.705383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:44.706124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:44.706575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:44.706994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:44.877776 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:44.885263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0b26e5a3-1dc7-4d47-9331-42aa647ee2fb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.199177 Aug 17 11:28:44.885878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 411/807] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:44 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:45.907280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:45.907847 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:45.915272 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:45.915666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:45.916093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:45.916837 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:45.917287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:45.917788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:46.061806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:46.070064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3555231c-483e-4092-b1ec-fe219e0e8fca tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.166996 Aug 17 11:28:46.070628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 397/808] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:45 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:47.095512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:47.096734 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:47.100205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:47.106321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:47.106868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:47.107347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:47.108117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:47.108619 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:47.109092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:47.256533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:47.266407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-50055123-f53a-4dba-9889-6fe064761534 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.177413 Aug 17 11:28:47.266975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 412/809] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:47 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:48.288192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:48.288915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:48.291113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:48.297090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:48.297678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:48.298109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:48.298805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:48.299260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:48.299678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:48.429134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:48.436880 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-57352dfb-7df6-46a3-a7fd-c7a65e6b718b tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.152740 Aug 17 11:28:48.437627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 398/810] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:48 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:49.461034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:49.461673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:49.468542 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:49.469027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:49.469471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:49.470162 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:49.470610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:49.471022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:49.610209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:49.618291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-90665854-4eac-40cd-b259-a509cb373008 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.161487 Aug 17 11:28:49.618856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 413/811] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:49 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:50.650908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:50.651819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:50.661760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.662230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.662662 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:50.663351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.663803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.664227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:50.802911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:50.810566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9dbffcfa-6998-412e-9b1d-1474bbf6986e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1570 microversion: 2.1 time: 0.166303 Aug 17 11:28:50.811166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 399/812] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:50 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:50.831245 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:50.831814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:50.838853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.839327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.839987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:50.841466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.842018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.842439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:50.888347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120583) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 11:28:50.963053 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-663b5a28-4084-4bb2-98bd-c151f8ec4721 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "POST /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae/action" status: 202 len: 0 microversion: 2.1 time: 0.135623 Aug 17 11:28:50.963574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 414/813] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:28:50 2022] POST /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 11:28:50.971751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:50.973076 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:50.979619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.980218 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.980741 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:50.981469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:50.981929 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:50.982626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:51.117038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:51.124898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-aa7f3ac0-16f9-4d1e-9f12-6cf01981930c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1518 microversion: 2.1 time: 0.157095 Aug 17 11:28:51.125534 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 400/814] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:50 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:52.150657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:52.151520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:52.160661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:52.161173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:52.161645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:52.162343 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:52.162794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:52.163196 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:52.304633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:52.308117 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:52.313093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0cdef380-f4ee-4373-a3c1-72370dc70d38 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1520 microversion: 2.1 time: 0.169508 Aug 17 11:28:52.313768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 415/815] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:52 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:53.335022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:53.335660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:53.343023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:53.343734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:53.344172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:53.344966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:53.345452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:53.345890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:53.487869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:53.496180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3ea2220f-9bda-4f6c-b128-480bc0d2db26 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.165074 Aug 17 11:28:53.496974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 401/816] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:53 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:54.139152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "name": "network-vif-unplugged", "status": "completed", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:28:54.150197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:54.150669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:54.151951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:54.164483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] Creating event network-vif-unplugged:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:28:54.169927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-2673b0c0-331e-400f-a79f-03d3000d77fe req-f9516676-8931-4743-85d1-d9ea777cd987 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034483 Aug 17 11:28:54.170515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 416/817] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:54.522720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:54.523689 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:54.534532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:54.535286 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:54.535716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:54.536411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:54.536835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:54.537257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:54.674020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:54.682165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-558818e5-44d2-4af9-91ab-eb7f00f5edeb tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.166210 Aug 17 11:28:54.682736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 402/818] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:54 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:55.704490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:55.705179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:55.711853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:55.712349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:55.712773 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:55.713461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:55.713922 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:55.714335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:55.858885 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:55.866900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6cdf3674-a701-4f8d-b42e-050d4b324c07 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.166755 Aug 17 11:28:55.867465 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 417/819] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:55 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:56.779632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:56.780165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:56.786982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.787464 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.787899 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:56.788570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.789054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.789509 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:56.872282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lazy-loading 'services' on Instance uuid 373351f7-7c12-4ae6-8a01-aec1209a3e5c {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:28:56.887722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:56.888308 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:56.895234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.895573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.896014 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:56.896726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.897203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.897653 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:56.949075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-340315e8-ff10-4574-a0c5-e52fc8bdbff7 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments/a7c5d745-c13e-4d39-b0fb-ae72c4589bf0" status: 202 len: 0 microversion: 2.1 time: 0.173345 Aug 17 11:28:56.949978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 403/820] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:28:56 2022] DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments/a7c5d745-c13e-4d39-b0fb-ae72c4589bf0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:28:56.959008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:56.961480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:56.968182 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.968578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.968988 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:56.969750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:56.970187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:56.970609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:57.006828 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-341887ca-ce50-4356-9088-9126955a6014 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051846 Aug 17 11:28:57.007537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 404/821] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:28:56 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:28:57.036036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:57.043601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-348b947c-9c3a-4128-9e61-a36b6db32acc tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.159817 Aug 17 11:28:57.044155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 418/822] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:56 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:58.019582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:58.021715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:58.028572 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.029062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.029529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.030209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.030655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.031070 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.059061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ffb17386-0279-411e-be4b-273dbc717fc5 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043554 Aug 17 11:28:58.059593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 405/823] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:28:58 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:28:58.064384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:58.065067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:58.072341 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.072827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.073251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.073971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.074412 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.074823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.137830 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:58.138325 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:58.144239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.144713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.145138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.145879 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.146326 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.146740 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.150800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:58.172868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:28:58.206973 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:58.214783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3507376b-b64b-44d6-8c8b-7de885c3fffe tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.154319 Aug 17 11:28:58.215441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 419/824] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:58 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:58.251763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f6c2779a-71f7-4914-8032-806006357410 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 204 len: 0 microversion: 2.1 time: 0.117495 Aug 17 11:28:58.252407 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 406/825] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:28:58 2022] DELETE /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 11:28:58.260831 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:58.261502 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:58.267583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.268060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.268480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.269157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:58.269686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:58.270046 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:58.402516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:58.410544 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a228d1fb-f3b4-4633-8e47-cf317bb0c236 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1689 microversion: 2.1 time: 0.153698 Aug 17 11:28:58.411160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 420/826] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:58 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:28:59.241287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:59.242284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:59.251519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:59.252173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:59.252745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:59.253711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:59.254311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:59.254867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:59.390972 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:59.398876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9390efd1-e80a-4782-bf46-a941d7a2484c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.165259 Aug 17 11:28:59.399443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 407/827] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:59 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:28:59.432071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:28:59.432670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:28:59.439706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:59.440177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:59.440624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:59.441313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:28:59.441797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:28:59.442213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:28:59.578995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:28:59.586893 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-edfcc424-66be-4ada-bc1c-fe61f42b753c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1689 microversion: 2.1 time: 0.158773 Aug 17 11:28:59.587461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 421/828] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:28:59 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:00.424099 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:00.425085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:00.435863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:00.436668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:00.437387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:00.438566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:00.439467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:00.440231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:00.581841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:00.589726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-79753381-555b-4e50-9b37-011a9571bf1e tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.171933 Aug 17 11:29:00.590279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 408/829] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:00 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:00.612726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:00.613331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:00.619981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:00.620455 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:00.620880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:00.621602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:00.622032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:00.622443 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:00.761524 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:00.769264 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-34b1983a-0b8a-478f-a113-9c3f355c131b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1689 microversion: 2.1 time: 0.160433 Aug 17 11:29:00.769891 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 422/830] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:00 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:01.615196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:01.616289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:01.627361 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:01.628347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:01.629068 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:01.630281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:01.631042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:01.631729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:01.765350 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:01.776082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a64c6840-983b-4569-a6d6-23b1faff6703 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.167047 Aug 17 11:29:01.777047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 409/831] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:01 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:01.790344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:01.790983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:01.797450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:01.797974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:01.798395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:01.799075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:01.799518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:01.799900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:01.927862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:01.935606 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ffb2a505-0eca-4cd8-a8a1-f72f94a7d485 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1689 microversion: 2.1 time: 0.149266 Aug 17 11:29:01.936146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 423/832] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:01 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:02.801970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:02.803026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:02.809995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:02.810481 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:02.810910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:02.811597 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:02.812046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:02.812465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:02.945941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:02.953937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-796ec7a5-a2b7-444c-9213-49178ba8da48 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.158205 Aug 17 11:29:02.958027 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:02.959648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:02.964159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 410/833] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:02 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:02.969052 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:02.969567 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:02.970047 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:02.970761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:02.971218 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:02.971671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:03.108576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:03.116383 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-200ba03b-63d8-4877-8799-5167e8036dcf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1689 microversion: 2.1 time: 0.162754 Aug 17 11:29:03.116947 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 424/834] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:02 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:03.870311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373351f7-7c12-4ae6-8a01-aec1209a3e5c", "name": "network-vif-deleted", "tag": "37c7bd52-d4a1-4b10-ba46-6e385142e9f0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:03.879832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:03.880307 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:03.880730 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:03.891950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] Creating event network-vif-deleted:37c7bd52-d4a1-4b10-ba46-6e385142e9f0 for instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c on hv-cinder-85345 Aug 17 11:29:03.897085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-30a13705-7e92-4204-9aca-370ff3464c47 req-c6b499ad-62ea-45e8-8f89-501c67d3325d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030419 Aug 17 11:29:03.897726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 411/835] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:03.975636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:03.976246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:03.982984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:03.983742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:03.984354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:03.985035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:03.985516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:03.986147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:04.132195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:04.138480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:04.139286 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:04.145791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7350ac81-e8fa-48aa-926e-b5d556032c2d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1576 microversion: 2.1 time: 0.172781 Aug 17 11:29:04.147360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:04.147959 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 425/836] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:03 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:04.148098 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:04.148499 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:04.149403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:04.150007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:04.150494 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:04.227995 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:04.236001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-95c7e104-a48a-4a8d-af27-5d0d30ca1ca1 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1330 microversion: 2.1 time: 0.102784 Aug 17 11:29:04.237043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 412/837] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:04 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:05.168107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:05.168658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:05.175297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:05.175785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:05.176217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:05.176913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:05.177365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:05.177837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:05.261161 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:05.261871 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:05.268542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:05.270076 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:05.270510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:05.271199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:05.271638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:05.272104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:05.305613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:05.306074 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:05.306498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:05.306935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lazy-loading 'fault' on Instance uuid 373351f7-7c12-4ae6-8a01-aec1209a3e5c {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:29:05.343078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:05.351028 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-31ccc677-6996-4749-82a4-63c990d9409d tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1563 microversion: 2.1 time: 0.186929 Aug 17 11:29:05.351677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 426/838] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:05 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:05.359756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:05.366993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cb9c6eb7-c597-4a04-a34c-b18e58d7da0a tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 200 len: 1335 microversion: 2.1 time: 0.110375 Aug 17 11:29:05.367587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 413/839] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:05 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:06.242234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "name": "network-vif-plugged", "status": "completed", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:06.251797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:06.252299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:06.252692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:06.263852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] Creating event network-vif-plugged:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:29:06.269303 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-9b89ad9d-acb7-4610-a818-4514bc5c5151 req-c1cdbbcb-80dd-4b01-9ba8-1cb092529f79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Aug 17 11:29:06.270136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 427/840] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:06.392089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:06.393112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: 373351f7-7c12-4ae6-8a01-aec1209a3e5c] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:06.404036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:06.404836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:06.405618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:06.406760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:06.407522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:06.408233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:06.423315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] HTTP exception thrown: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Request method failure captured: Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c HTTP/1.1 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M8xQsP11rqoHSeqYadoRVeDEYhp-4efQLBtYZ9ExNFk7m0a63FVlWNxjOovefVWXJCcfgx7dmg8VkIZPNKffCwErdnV6CxJIx2SVb6bGfPUP5ckg8D2etpmBFaTnuAdFGJ_9g-sJoNGDR5WPjEkaxTAahOxiWBxfx2fE6RaOSQZwJI Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:29:06.424948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56b9f381040f4998bfaf4fc07a995380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: b5b61f023e1a403da575d83027e777ee Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. Aug 17 11:29:06.426610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '373351f7-7c12-4ae6-8a01-aec1209a3e5c'} Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:29:06.427531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. Aug 17 11:29:06.429156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:06.430564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Returning 404 to user: Instance 373351f7-7c12-4ae6-8a01-aec1209a3e5c could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:29:06.430564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-dfcc5a4b-6863-44c2-823c-c9d2a51d393f tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c" status: 404 len: 111 microversion: 2.1 time: 0.040974 Aug 17 11:29:06.430564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 414/841] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:06 2022] GET /compute/v2.1/servers/373351f7-7c12-4ae6-8a01-aec1209a3e5c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:29:06.435810 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-14ac250a-10b2-4423-8f1a-d1a1194fe07b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '.version_select at 0x7f904813f9d0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:06.458043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-14ac250a-10b2-4423-8f1a-d1a1194fe07b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345759564" status: 202 len: 0 microversion: 2.1 time: 0.026371 Aug 17 11:29:06.458543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 428/842] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345759564 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:29:09.350586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:09.351146 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:09.358147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:09.358635 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:09.359069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:09.359770 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:09.360219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:09.360626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:09.385939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:29:09.466607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1514e73e-d9e3-41cb-909b-774761db086c tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 204 len: 0 microversion: 2.1 time: 0.121793 Aug 17 11:29:09.467432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 415/843] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:29:09 2022] DELETE /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:29:09.476183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:09.476975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:09.483038 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:09.483512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:09.483941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:09.484617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:09.485065 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:09.485525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:09.619174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:09.627175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-500d9ef3-dd65-4f63-82ec-9092d1caaebc tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1506 microversion: 2.1 time: 0.155545 Aug 17 11:29:09.627740 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 429/844] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:09 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:10.648752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:10.649413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:10.656188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:10.656669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:10.657094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:10.657823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:10.658271 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:10.658684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:10.800169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:10.809633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-58ddc920-8cff-4296-9d26-e55c924f6586 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 200 len: 1506 microversion: 2.1 time: 0.164469 Aug 17 11:29:10.824203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 416/845] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:10 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:10.848072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2", "name": "network-vif-deleted", "tag": "663da14f-9922-4188-8480-48ee8990935e"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:10.860208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:10.860676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:10.861104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:10.874493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] Creating event network-vif-deleted:663da14f-9922-4188-8480-48ee8990935e for instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 on hv-cinder-85345 Aug 17 11:29:10.880631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-4f037305-8188-40dd-84f7-03669ba88788 req-afcbda12-d2e9-4fcf-952c-0fcf209833c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Aug 17 11:29:10.881354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 430/846] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:11.835553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:11.836315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:11.844805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:11.845405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:11.845994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:11.846850 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:11.847422 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:11.847952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:11.867193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] HTTP exception thrown: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Request method failure captured: Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 HTTP/1.1 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M8xQsP11rqoHSeqYadoRVeDEYhp-4efQLBtYZ9ExNFk7m0a63FVlWNxjOovefVWXJCcfgx7dmg8VkIZPNKffCwErdnV6CxJIx2SVb6bGfPUP5ckg8D2etpmBFaTnuAdFGJ_9g-sJoNGDR5WPjEkaxTAahOxiWBxfx2fE6RaOSQZwJI Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:29:11.868808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56b9f381040f4998bfaf4fc07a995380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: b5b61f023e1a403da575d83027e777ee Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. Aug 17 11:29:11.870319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2'} Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:29:11.871266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. Aug 17 11:29:11.872890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:29:11.874396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Returning 404 to user: Instance a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:29:11.874396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-12ed02ad-07b9-4c03-a553-fc70515debb0 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2" status: 404 len: 111 microversion: 2.1 time: 0.041096 Aug 17 11:29:11.874396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 417/847] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:11 2022] GET /compute/v2.1/servers/a3a8d3e2-bc1f-4f04-b961-e65fe0e4f1c2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:29:11.879356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:11.879941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:11.886765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:11.887247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:11.887682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:11.888392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:11.888850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:11.889273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:11.914844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:29:11.996433 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-75053be1-ec05-42f1-bea6-394037a3ca8b tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 204 len: 0 microversion: 2.1 time: 0.120968 Aug 17 11:29:11.997799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 431/848] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:29:11 2022] DELETE /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:29:12.005682 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:12.006292 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:12.013074 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:12.013579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:12.014007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:12.014922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:12.015394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:12.015786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:12.149970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:12.157775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-eb266556-13b2-4e9c-8bf2-a3b54fbc00f9 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1522 microversion: 2.1 time: 0.155941 Aug 17 11:29:12.158332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 418/849] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:12 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:13.179659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:13.180341 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:13.187043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:13.187528 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:13.187958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:13.188666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:13.189114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:13.189553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:13.266816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b61f023e1a403da575d83027e777ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b9f381040f4998bfaf4fc07a995380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:13.274965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-75f57352-673f-4b37-8db7-681fcc2e73cf tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 200 len: 1480 microversion: 2.1 time: 0.099684 Aug 17 11:29:13.275536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 432/850] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:13 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 1480 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:13.297036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaec248d-889a-4d44-8bca-0de312ec1cb5", "name": "network-vif-deleted", "tag": "d9e663d4-7e87-41de-a96a-dc3196a24e5c"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:13.307123 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:13.307594 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:13.308016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:13.319316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] Creating event network-vif-deleted:d9e663d4-7e87-41de-a96a-dc3196a24e5c for instance aaec248d-889a-4d44-8bca-0de312ec1cb5 on hv-cinder-85345 Aug 17 11:29:13.324069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-31ce7935-6b02-45a2-aef3-fe984c53fc25 req-1257d2db-5794-472a-98d9-22596045ff52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030889 Aug 17 11:29:13.324822 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 419/851] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:14.298114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:14.298741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] [instance: aaec248d-889a-4d44-8bca-0de312ec1cb5] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:14.306182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:14.306662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:14.307091 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:14.307781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:14.308230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:14.308647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:14.322771 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] HTTP exception thrown: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Request method failure captured: Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 HTTP/1.1 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M8xQsP11rqoHSeqYadoRVeDEYhp-4efQLBtYZ9ExNFk7m0a63FVlWNxjOovefVWXJCcfgx7dmg8VkIZPNKffCwErdnV6CxJIx2SVb6bGfPUP5ckg8D2etpmBFaTnuAdFGJ_9g-sJoNGDR5WPjEkaxTAahOxiWBxfx2fE6RaOSQZwJI Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:29:14.324384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56b9f381040f4998bfaf4fc07a995380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56b9f381040f4998bfaf4fc07a995380", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 56b9f381040f4998bfaf4fc07a995380 Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1113660709 Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: b5b61f023e1a403da575d83027e777ee Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1113660709-project Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. Aug 17 11:29:14.325972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'aaec248d-889a-4d44-8bca-0de312ec1cb5'} Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:29:14.326951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. Aug 17 11:29:14.328592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:29:14.330181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] Returning 404 to user: Instance aaec248d-889a-4d44-8bca-0de312ec1cb5 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:29:14.330181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f09e8aab-9911-488f-b7cf-6f72a289c7a6 tempest-ServerRescueNegativeTestJSON-1113660709 tempest-ServerRescueNegativeTestJSON-1113660709-project] 10.222.0.15 "GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5" status: 404 len: 111 microversion: 2.1 time: 0.034021 Aug 17 11:29:14.330181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 433/852] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:14 2022] GET /compute/v2.1/servers/aaec248d-889a-4d44-8bca-0de312ec1cb5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:29:23.307352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9021f70b-4e88-44bc-9e1c-9b2bcb04c0b3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: .version_select at 0x7f904409b430>, body: {"keypair": {"name": "tempest-keypair-1935600662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMckYMJHC471yX4Q6lDkc/IzvjvL7o89ermLXTvfvepFCElAYqpbLpxayzOd0h78l/WCKEvQ5b9gjEVhKuEIBPOC69a5WxXNFf1nkW5WaOUHbLPwgBd3sCx7VwsVyj96NA=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:23.312919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:23.313599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:23.329628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-9021f70b-4e88-44bc-9e1c-9b2bcb04c0b3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:29:23.334729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-9021f70b-4e88-44bc-9e1c-9b2bcb04c0b3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for user 3a30088eecfc49de963e995292e58832 and project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:29:23.358969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9021f70b-4e88-44bc-9e1c-9b2bcb04c0b3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308024 Aug 17 11:29:23.359587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 420/853] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:29:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:24.651847 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-961630919", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06bac9dc-dc7c-4653-af9c-5cd9b49c79f8"}], "security_groups": [{"name": "tempest-securitygroup--1628404975"}], "key_name": "tempest-keypair-1935600662", "user_data": "}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:24.660366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:24.661000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:24.764752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] validate_networks() for [('06bac9dc-dc7c-4653-af9c-5cd9b49c79f8', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:29:25.167957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:29:25.168380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:29:25.168850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:29:25.169254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:29:25.170446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:29:25.180838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:25.181459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:25.181896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:25.182930 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:25.183386 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:25.183806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:25.203078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:29:25.208521 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for user 3a30088eecfc49de963e995292e58832 and project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:29:25.221046 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:29:25.224656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:29:25.283750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6456e902-c2b8-40ab-9a31-42df3c4666a4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.636096 Aug 17 11:29:25.284734 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 434/854] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:29:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:29:25.295700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-637d1239-dfdf-458a-b193-e4641ca0a2e4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:25.296435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-637d1239-dfdf-458a-b193-e4641ca0a2e4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:25.369720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-637d1239-dfdf-458a-b193-e4641ca0a2e4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:25.378930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-637d1239-dfdf-458a-b193-e4641ca0a2e4 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1237 microversion: 2.1 time: 0.087076 Aug 17 11:29:25.381502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 421/855] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:25 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:26.400106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:26.401365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:26.408876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:26.409368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:26.409825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:26.410560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:26.411005 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:26.411446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:26.477684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:26.486173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4227eee3-3c69-4692-8ec0-c245aa44c60e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1297 microversion: 2.1 time: 0.090569 Aug 17 11:29:26.486749 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 435/856] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:26 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:27.509729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:27.516664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:27.525915 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:27.526665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:27.527168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:27.528140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:27.528630 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:27.529056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:27.664884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:27.673034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7f86d31e-7a50-4f60-9994-adc4a5479f85 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.168576 Aug 17 11:29:27.673649 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 422/857] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:27 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:27.919433 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57c49bd-ede7-46e2-9c1a-9e6645f10e41", "tag": "fe3081f5-1d78-4d7e-a3cc-034734c85951"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:27.930433 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:27.931018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:27.931499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:27.943302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] Creating event network-changed:fe3081f5-1d78-4d7e-a3cc-034734c85951 for instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 on hv-cinder-85345 Aug 17 11:29:27.948108 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-019a3989-ade2-4bd4-a2c6-3178753dd2f4 req-c8270d2f-8e06-40d1-a93c-93c60c8e130f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032548 Aug 17 11:29:27.948721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 436/858] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:28.699401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:28.700451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:28.711619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:28.712431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:28.713170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:28.714392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:28.715158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:28.715864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:28.852187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:28.859743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-17d90c0f-104d-4858-afaa-778fb7006017 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.167936 Aug 17 11:29:28.860314 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 423/859] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:28 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:29.886602 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:29.887637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:29.898150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:29.899810 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:29.900837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:29.901596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:29.902067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:29.902490 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:30.035087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:30.043285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6c09eb98-cdcf-4245-aec9-bd66ad8e4b11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.164689 Aug 17 11:29:30.043911 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 437/860] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:29 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:31.071699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:31.073268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:31.080293 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:31.081020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:31.081641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:31.082508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:31.083112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:31.083837 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:31.219363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:31.227252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c5f165c8-4899-4e6e-aef2-367492b6c517 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.163934 Aug 17 11:29:31.227811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 424/861] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:31 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:29:32.247944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:32.248567 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:32.254981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:32.255460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:32.255882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:32.256562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:32.256981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:32.257578 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:32.386851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:32.396354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-183d8522-08ae-4bd8-bcd9-03861c37b43a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.152324 Aug 17 11:29:32.396972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 438/862] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:32 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:33.419908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:33.420534 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:33.428093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:33.428631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:33.429113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:33.429917 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:33.430423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:33.430890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:33.570420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:33.578245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-053bafd1-37b6-422a-bfcc-dd91889f346d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.163421 Aug 17 11:29:33.578846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 425/863] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:33 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:34.417799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c49bd-ede7-46e2-9c1a-9e6645f10e41", "name": "network-vif-plugged", "status": "completed", "tag": "fe3081f5-1d78-4d7e-a3cc-034734c85951"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:34.428752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:34.429236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:34.429921 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:34.441757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] Creating event network-vif-plugged:fe3081f5-1d78-4d7e-a3cc-034734c85951 for instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 on hv-cinder-85345 Aug 17 11:29:34.447024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a426464e-ef69-4129-ae29-aeb132724094 req-54cfbcbb-f3fd-45d2-8ee3-1da35e2362b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034054 Aug 17 11:29:34.447615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 439/864] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:34.599700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:34.600395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:34.607599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:34.608090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:34.608511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:34.609205 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:34.609704 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:34.610116 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:34.744319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:34.752004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-aaf5916b-b4a5-4206-8e53-194566c15c03 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.156302 Aug 17 11:29:34.752658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 426/865] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:34 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:35.772843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:35.774799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:35.782124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:35.783235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:35.793797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:35.794284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:35.794730 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:35.795420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:35.795868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:35.796282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:35.934075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:35.942220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f352324f-0902-4221-be11-361e8417cd65 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1363 microversion: 2.1 time: 0.171245 Aug 17 11:29:35.943093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 440/866] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:35 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:36.964136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:36.964776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:36.966805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:36.972961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:36.973385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:36.973867 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:36.974580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:36.975051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:36.975489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:37.117026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:37.129255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-afcfb22f-8bc7-4aa9-a28e-26e8fbf02c55 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1548 microversion: 2.1 time: 0.168982 Aug 17 11:29:37.130145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 427/867] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:29:36 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:29:37.155373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:37.155910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:37.162736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:37.163214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:37.163644 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:37.164332 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:37.164780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:37.165198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:37.244248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-edde3521-bc93-4055-bfac-43b2095bb022 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092893 Aug 17 11:29:37.244872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 441/868] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:29:37 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:38.175308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57c49bd-ede7-46e2-9c1a-9e6645f10e41", "tag": "fe3081f5-1d78-4d7e-a3cc-034734c85951"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:38.185218 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:38.185728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:38.186165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:38.197467 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] Creating event network-changed:fe3081f5-1d78-4d7e-a3cc-034734c85951 for instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 on hv-cinder-85345 Aug 17 11:29:38.202533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-6f3f6afa-d96e-494a-94bf-e95d655094a5 req-d466004b-1f5c-4d6b-967d-a7bfc854006c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030906 Aug 17 11:29:38.203119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 428/869] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:29:56.315279 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:56.317295 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=34 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:56.324939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:56.325806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:56.338124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:56.338906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:56.339618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:56.340755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:56.341543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:56.342244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:56.366791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ee464826-4f89-4925-bc6a-3b267bc05e4c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/ips" status: 200 len: 152 microversion: 2.20 time: 0.054344 Aug 17 11:29:56.367355 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 442/870] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 11:29:56 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:29:58.230329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:58.231517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=38 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:58.236924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:29:58.237569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:58.245155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:58.245677 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:58.246103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:58.246790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:58.247245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:58.247664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:58.270866 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lazy-loading 'flavor' on Instance uuid acde00db-f3f6-4404-a789-72b324341b43 {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:29:58.455133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b1b41bf2-9c3a-40f6-b24c-ab26697eb259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/action" status: 202 len: 0 microversion: 2.20 time: 0.227556 Aug 17 11:29:58.455786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 429/871] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 11:29:58 2022] POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:29:58.465293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:58.465975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:58.472793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:58.473282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:58.473748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:58.474534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:58.474985 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:58.475405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:58.610515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:58.619209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:58.620697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:58.621904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a8771507-f5e0-4284-b976-45f31fb416d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.161560 Aug 17 11:29:58.622483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 443/872] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:29:58 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:29:59.649508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:29:59.650471 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:29:59.660004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:59.660624 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:59.661193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:59.662157 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:29:59.662748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:29:59.663295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:29:59.807524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:59.819869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:59.822280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:29:59.824090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-30e5de80-760f-48cf-8b21-2cf92ed746c1 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.180800 Aug 17 11:29:59.824984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 430/873] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:29:59 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:00.852982 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:00.854232 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:00.866321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:00.867177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:00.867900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:00.869067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:00.869920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:00.870636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:01.003574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:01.012119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:01.013826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:01.014983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cd580a65-45ba-4bce-ba9e-fbd35b02f729 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.168586 Aug 17 11:30:01.015520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 444/874] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:00 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:02.042812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:02.043916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:02.053011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:02.053579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:02.054231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:02.054768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:02.055239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:02.055660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:02.188519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:02.197392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:02.199145 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:02.200311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e9cd69b5-0256-4acc-b309-d8ee59d46aa7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.164319 Aug 17 11:30:02.200873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 431/875] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:02 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:03.227590 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:03.228441 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:03.238536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:03.239039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:03.239471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:03.240163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:03.240618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:03.241040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:03.378150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:03.390439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:03.392737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:03.394493 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-16e7f14f-851a-45c6-9de9-ce970ef419d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.173590 Aug 17 11:30:03.395050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 445/876] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:03 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:04.419709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:04.420348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:04.428465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:04.429040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:04.429595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:04.430408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:04.430949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:04.431448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:04.566354 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:04.574985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:04.576450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:04.577660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cb464339-d44b-4a7a-8b9a-9413c4062509 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.162905 Aug 17 11:30:04.578216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 432/877] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:04 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:05.605057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:05.606092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:05.616166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:05.616673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:05.617099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:05.617805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:05.618252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:05.618661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:05.756240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:05.764198 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:05.765706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:05.766853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0548050f-d225-4001-8ac3-3f5f52938bd5 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.168874 Aug 17 11:30:05.767400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 446/878] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:05 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:06.794130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:06.795083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:06.806047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:06.806869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:06.807588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:06.808729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:06.809578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:06.810250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:07.112780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:07.121177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:07.122727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:07.123914 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f1a9c673-e04a-4a48-8376-6fe38ab5144a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.336457 Aug 17 11:30:07.124471 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 433/879] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:06 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:08.147375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:08.148006 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:08.154817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:08.155293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:08.155718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:08.156409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:08.156852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:08.157266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:08.292514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:08.301081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:08.302621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:08.303783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-982ec079-5d12-4972-9664-8f1883ebb32d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.160521 Aug 17 11:30:08.304422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 447/880] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:08 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:09.331153 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:09.332022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:09.340705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:09.341203 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:09.341671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:09.342377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:09.342812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:09.343227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:09.474360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:09.482580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:09.484057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:09.485196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f5eb7d3f-c56d-4a6f-856d-cd30c7a01a90 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.160848 Aug 17 11:30:09.485777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 434/881] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:09 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:10.508277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:10.508942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:10.515783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:10.516271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:10.516695 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:10.517392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:10.518217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:10.518632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:10.652086 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:10.660223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:10.661706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:10.662881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5f043d73-ae26-45d4-9d60-0db344a0ca78 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1746 microversion: 2.20 time: 0.158705 Aug 17 11:30:10.663498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 448/882] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:10 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:11.690524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:11.691392 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:11.700722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:11.701244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:11.701744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:11.702448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:11.702897 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:11.703360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:11.837722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:11.846026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:11.847528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:11.848685 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-54d92ba6-0845-4a6e-84c7-c7d3b77f0e6d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1746 microversion: 2.20 time: 0.164844 Aug 17 11:30:11.849250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 435/883] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:11 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:12.544736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "name": "network-vif-plugged", "status": "completed", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:12.560645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:12.561369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:12.561961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:12.575372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] Creating event network-vif-plugged:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:30:12.580862 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-c6ab935e-e66a-4f12-90b6-68b23c1b77e2 req-d5a26a06-ee8d-446b-999a-8eefb58b3102 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040442 Aug 17 11:30:12.581471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 449/884] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:30:12.871883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:12.872451 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:12.880869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:12.881352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:12.881811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:12.882531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:12.882967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:12.883994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:13.009163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:13.017604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:13.019231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:13.020418 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3f691dca-f88a-4f06-8554-c7f139c0dc8c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1746 microversion: 2.20 time: 0.152583 Aug 17 11:30:13.020949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 436/885] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:12 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:14.044744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:14.045462 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:14.052333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:14.052774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:14.053220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:14.054000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:14.054449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:14.055097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:14.436996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:14.446805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:14.448373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:14.449582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3bcdad36-89f9-4079-a76a-c4c97578c70c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1746 microversion: 2.20 time: 0.409743 Aug 17 11:30:14.450326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 450/886] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:14 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1746 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:15.476520 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:15.477519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:15.484528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:15.485017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:15.485448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:15.486170 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:15.486627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:15.487047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:15.615852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:15.624193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:15.625697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:15.626855 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-88a259df-cdd2-44a4-a4d0-fd18d283c863 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1746 microversion: 2.20 time: 0.156950 Aug 17 11:30:15.627412 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 437/887] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:15 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:16.650823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:16.652138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:16.661217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:16.662139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:16.662650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:16.663421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:16.664103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:16.664745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:16.825664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:16.834825 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:16.838850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:16.841577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-afae75ca-ee33-44ea-b7e2-a104d7846aa9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.194884 Aug 17 11:30:16.842161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 451/888] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:16 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:17.868274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:17.868927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:17.874992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:17.875681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:17.876304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:17.876983 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:17.877618 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:17.878190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:18.018543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:18.026840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:18.028334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:18.029536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0a2f00e9-94ff-409e-aec0-3a0feadc07d2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.165660 Aug 17 11:30:18.042788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 438/889] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:17 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:19.055450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:19.056290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:19.063482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:19.064110 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:19.064845 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:19.065837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:19.066363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:19.066852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:19.234883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:19.260677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:19.264621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:19.271923 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b701ac89-318c-4c4e-ad39-bbe3d0744706 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.219922 Aug 17 11:30:19.272556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 452/890] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:19 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:20.295421 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:20.295967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:20.303006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:20.303234 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:20.303657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:20.304430 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:20.304883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:20.305343 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:20.441095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:20.449386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:20.450898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:20.452055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2e8842d2-5e64-45af-9bd2-240f34ce6769 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.160676 Aug 17 11:30:20.452610 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 439/891] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:20 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:21.475966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:21.476588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:21.483854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:21.484335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:21.484760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:21.485517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:21.485978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:21.486393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:21.630830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:21.639372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:21.642609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:21.642609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b08bcde1-071c-41f7-afc7-7227a6065212 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.170438 Aug 17 11:30:21.642882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 453/892] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:21 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:22.666041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:22.666700 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:22.673453 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:22.673924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:22.674584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:22.675437 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:22.675888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:22.676300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:22.832738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:22.841297 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:22.843039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:22.846363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-68bf43bf-c39e-4573-8f5f-0b4277382cb7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.182329 Aug 17 11:30:22.853029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 440/893] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:22 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:30:23.869099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:23.869979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:23.876874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:23.877391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:23.877881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:23.878811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:23.879290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:23.879722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:24.038313 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:24.047509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:24.049034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:24.050319 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-66fc9a0e-adc4-4800-942a-3085bed0895b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.185603 Aug 17 11:30:24.062350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 454/894] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:23 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:25.074306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:25.074886 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:25.083349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:25.084018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:25.084440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:25.085155 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:25.085619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:25.086051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:25.244118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:25.252154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:25.253666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:25.254961 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-79258b95-c511-4c91-9777-aa93af7c7609 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.184624 Aug 17 11:30:25.255836 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 441/895] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:25 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:26.282231 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:26.283193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:26.293878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:26.294656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:26.295446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:26.296543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:26.297350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:26.298089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:26.435191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:26.437472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=77 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:26.444698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:26.446210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:26.447353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-549add4e-ebaf-4a78-9215-fe0fb275f425 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1741 microversion: 2.20 time: 0.171769 Aug 17 11:30:26.447901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 455/896] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:26 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:27.470043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:27.470631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:27.477514 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:27.478000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:27.478435 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:27.479190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:27.479649 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:27.480076 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:27.627154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:27.635423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:27.636926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:27.638151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-45803532-167d-4c26-8b98-23a48f630355 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1723 microversion: 2.20 time: 0.172162 Aug 17 11:30:27.638747 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 442/897] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:27 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:28.576821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "name": "network-vif-unplugged", "status": "completed", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:28.582109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=29 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:28.588139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:28.589375 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:28.589828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:28.601604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] Creating event network-vif-unplugged:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:30:28.606813 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-ee070ccd-a8f5-422a-92ff-86321931062f req-c00c898f-b1e6-4002-ab0d-8f48af0882d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034246 Aug 17 11:30:28.607682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 456/898] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:30:28.661285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:28.663381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:28.665872 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=29 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:28.673875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:28.674372 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:28.674806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:28.675504 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:28.675958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:28.676380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:28.679318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:28.821323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:28.830119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:28.831622 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:28.832786 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bf0e4aca-c110-4d71-9825-0d06448aa9d4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1723 microversion: 2.20 time: 0.175480 Aug 17 11:30:28.833355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 443/899] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:28 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:29.856856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:29.857624 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:29.864722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:29.865262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:29.865704 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:29.866406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:29.866852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:29.867284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.019069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:30.027447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:30.028946 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:30.030277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-504632ae-3f58-48b7-97bc-b313e97b4fc9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1726 microversion: 2.20 time: 0.177817 Aug 17 11:30:30.030837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 457/900] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:29 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1726 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:30.055331 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0efd470d-7897-4677-b41f-735e5ce48789"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:30.057923 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:30.064825 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.065634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.066100 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.066885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.067891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.070205 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.373948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-54f7ffc8-5a70-464a-9a54-03bb004f25f4 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323324 Aug 17 11:30:30.374500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 444/901] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 11:30:30 2022] POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 11:30:30.500806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:30.501320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:30.508519 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.509069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.509516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.511239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.511724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.512193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.759555 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ea67ac88-9773-4815-9b6e-78869c3f6d67 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments/0efd470d-7897-4677-b41f-735e5ce48789" status: 202 len: 0 microversion: 2.20 time: 0.262954 Aug 17 11:30:30.760252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 458/902] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 11:30:30 2022] DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments/0efd470d-7897-4677-b41f-735e5ce48789 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:30:30.822447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:30.823046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:30.829663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.830152 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.830591 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.831283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.831795 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.832327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.861952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120584) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 11:30:30.938626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1cc9498b-0441-41d0-b940-87187f4f9d98 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/action" status: 202 len: 0 microversion: 2.20 time: 0.120011 Aug 17 11:30:30.939675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 445/903] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 11:30:30 2022] POST /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:30:30.948752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:30.949367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:30.958112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.958598 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.959223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:30.960182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:30.960972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:30.961666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:31.121820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:31.130219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:31.131878 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:31.133270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d92478cf-170a-4991-9b57-a2e13f48948a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1674 microversion: 2.20 time: 0.188969 Aug 17 11:30:31.133922 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 459/904] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:30 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:32.157169 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:32.158482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:32.165838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:32.166350 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:32.166787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:32.167489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:32.167939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:32.168344 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:32.305669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:32.315977 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:32.317916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:32.319224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e5515ce7-a3a6-4913-b65d-d141fdfa1e18 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.166108 Aug 17 11:30:32.319736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 446/905] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:32 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:33.342402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:33.343714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:33.349963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:33.350443 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:33.350869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:33.351568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:33.352002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:33.352416 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:33.502494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:33.517998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:33.520790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:33.522601 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8257347b-0e8c-4e42-bb07-5fde4a68e95f tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.183651 Aug 17 11:30:33.523173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 460/906] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:33 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:34.554547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:34.555311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:34.563110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:34.563334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:34.563658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:34.564379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:34.564838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:34.565258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:34.735815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:34.746476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:34.748025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:34.749236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fb905177-c8cd-4773-88d3-0cfc2cc8a677 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.199562 Aug 17 11:30:34.750114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 447/907] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:34 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:35.772264 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:35.772882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:35.788430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:35.789011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:35.789494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:35.790257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:35.790708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:35.791125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:35.980420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:35.991270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:35.992755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:35.994023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b8d9964e-a594-40dc-b0fe-328ede8879d6 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.225766 Aug 17 11:30:36.005778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 461/908] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:35 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:37.018406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:37.019023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:37.025663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:37.026150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:37.026577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:37.027283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:37.027736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:37.028150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:37.191862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:37.203010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:37.204522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:37.205773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b0832cf2-11c9-4fe6-8c5d-e5a62027be44 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.191310 Aug 17 11:30:37.206724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 448/909] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:37 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:38.230160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:38.230728 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:38.239048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:38.239538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:38.240001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:38.240660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:38.241106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:38.241559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:38.403363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:38.424632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:38.426161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:38.427334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-78057488-6696-427b-95d2-78c1e3665f79 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.201359 Aug 17 11:30:38.428210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 462/910] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:38 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:39.453609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:39.454356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:39.461025 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:39.461637 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:39.462134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:39.462894 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:39.463390 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:39.463910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:39.608323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:39.617101 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:39.618774 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:39.620040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cfab5c31-f35a-401e-b957-ef1aecf2dee7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.170512 Aug 17 11:30:39.621852 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 449/911] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:39 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:40.644090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:40.644708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:40.652199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:40.652669 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:40.653180 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:40.653857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:40.654300 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:40.654701 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:40.790767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:40.799650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:40.801395 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:40.802641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-69f50c63-e996-493b-b1dd-1dc8491bd3b2 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.162585 Aug 17 11:30:40.803477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 463/912] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:40 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:41.827034 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:41.827668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:41.834426 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:41.834907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:41.835333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:41.836076 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:41.836547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:41.836891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.043552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:42.052309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:42.053883 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:42.055084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-eb8bb392-9a16-4eee-a575-dfd545e4c259 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.232002 Aug 17 11:30:42.055901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 450/913] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:41 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:42.631641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:42.632191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:42.638410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:42.647838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:42.648325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:42.648748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.649648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:42.650112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:42.650527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.650634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:42.651434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:42.651558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.662796 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] Creating event network-changed:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:30:42.668044 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-00c4f9f2-8216-460f-8d7e-9580e1704dee req-56437061-18ed-4a3a-9f3b-02a4a99269bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033278 Aug 17 11:30:42.668841 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 451/914] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:30:42.676417 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:30:42.751974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3302e970-d0b5-4f52-b85f-02ac3139bcaa tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "DELETE /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 204 len: 0 microversion: 2.1 time: 0.123885 Aug 17 11:30:42.752478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 464/915] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:30:42 2022] DELETE /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:30:42.761201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:42.761953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:42.768173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:42.768655 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:42.769093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.769812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:42.770296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:42.770762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:42.908163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:42.916142 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8475a7f3-a083-43a1-a784-57adef694e20 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.159140 Aug 17 11:30:42.916738 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 452/916] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:42 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:30:43.079141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:43.079832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:43.086647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:43.087257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:43.087757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:43.088519 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:43.089171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:43.089682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:43.225285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:43.234018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:43.235558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:43.236717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3c4e4655-f64f-459a-a862-2b1d7fd28496 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.161951 Aug 17 11:30:43.237280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 465/917] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:43 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:30:43.938369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:43.938978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:43.946247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:43.946722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:43.947150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:43.947835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:43.948289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:43.948708 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:44.091462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:44.099587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7cc4960d-a672-47cb-9391-d1d0060a5622 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.165118 Aug 17 11:30:44.100158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 453/918] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:43 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:30:44.264214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:44.265093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:44.275126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:44.275579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:44.276009 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:44.276700 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:44.277146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:44.277591 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:44.409446 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:44.421643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:44.423995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:44.425573 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-54ac0d39-014f-43d3-8734-246fa0d7fee9 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.168550 Aug 17 11:30:44.426280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 466/919] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:44 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:45.121931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:45.122546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:45.129529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:45.130020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:45.130472 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:45.131164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:45.131620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:45.132043 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:45.278493 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:45.286547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-50a92d5d-b0b7-49ad-82f4-610de9a2eae3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.168616 Aug 17 11:30:45.287112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 454/920] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:45 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:30:45.454711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:45.455690 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:45.466744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:45.467423 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:45.468149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:45.469310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:45.470119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:45.470824 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:45.611016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:45.620333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:45.621839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:45.622987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-72d21c16-a4ef-4c3f-a2dc-fcf1568d8cc7 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.174938 Aug 17 11:30:45.623569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 467/921] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:45 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:46.310580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:46.311287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:46.321726 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:46.322207 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:46.322629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:46.323305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:46.323752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:46.324362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:46.467532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:46.478870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6abc61c3-8d2b-4484-a3d0-d93fe89158f5 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.174005 Aug 17 11:30:46.479444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 455/922] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:46 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:30:46.649113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:46.649857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:46.662205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:46.662787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:46.663215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:46.663950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:46.664437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:46.665154 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:46.813655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:46.817579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:46.822618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:46.824100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:46.825251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8260c338-6932-4538-a521-15194c9fb654 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.180655 Aug 17 11:30:46.825836 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 468/923] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:46 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:47.502053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:47.502729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:47.510443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:47.511005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:47.511505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:47.512295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:47.512823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:47.513313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:47.655304 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:47.658296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:47.666348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7a1f4de5-07dc-4067-a239-886b0f5beb5f tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.168930 Aug 17 11:30:47.666926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 456/924] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:47 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:30:47.853290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:47.853890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:47.861170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:47.861697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:47.862158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:47.862848 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:47.863294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:47.863711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:47.992718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:48.000808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:48.002329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:48.003501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-189340db-f164-4d80-8070-4131a61cf631 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.156543 Aug 17 11:30:48.004050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 469/925] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:47 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:48.687681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:48.689119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:48.696918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:48.697720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:48.698407 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:48.699362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:48.700150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:48.700803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:48.953885 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:48.962336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-485f3318-227c-4adb-8c9f-d233b28c6d01 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1569 microversion: 2.1 time: 0.278282 Aug 17 11:30:48.974111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 457/926] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:48 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:30:49.026340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:49.027213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:49.034119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:49.034736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:49.035401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:49.036546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:49.037161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:49.037832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:49.278250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:49.289068 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:49.291022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:49.292333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7c4df731-7258-40b2-935f-52284d66da3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.270021 Aug 17 11:30:49.293087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 470/927] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:49 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:49.338823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320e37a2-baf8-4abc-b621-77f4516606ae", "name": "network-vif-deleted", "tag": "9e8efaf9-3eab-46fd-8939-d3f048041275"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:49.348162 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:49.348972 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:49.349695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:49.362010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] Creating event network-vif-deleted:9e8efaf9-3eab-46fd-8939-d3f048041275 for instance 320e37a2-baf8-4abc-b621-77f4516606ae on hv-cinder-85345 Aug 17 11:30:49.367242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-04a63614-506b-43e1-83c3-cced48990dfe req-6921d53d-77f7-4669-b241-77c15bbec8d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Aug 17 11:30:49.367987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 458/928] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:30:49.984830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:49.985377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:49.991648 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:49.992111 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:49.992538 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:49.993260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:49.993738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:49.994148 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:50.040270 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:50.040970 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:50.041267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:50.041848 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lazy-loading 'fault' on Instance uuid 320e37a2-baf8-4abc-b621-77f4516606ae {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:30:50.094274 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fedc8ba1f054629b21407989ac53a44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f442a74602f84e66a7615de64165786a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:50.104826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c8485c76-d1a3-4b39-bd18-6506042ae37c tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 200 len: 1225 microversion: 2.1 time: 0.124327 Aug 17 11:30:50.105404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 471/929] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:49 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:30:50.320393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:50.321000 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:50.327465 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:50.327955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:50.328391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:50.329086 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:50.329572 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:50.329994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:50.479243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:50.491912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:50.493930 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:50.495092 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2064d3e8-6766-40a4-b56d-446654d348de tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.180109 Aug 17 11:30:50.495679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 459/930] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:50 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:50.750216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "name": "network-vif-plugged", "status": "completed", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:30:50.762174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:50.762637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:50.763029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:50.774944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] Creating event network-vif-plugged:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:30:50.780011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-95b0bae3-6c47-4d13-ac05-cf071f702585 req-ec03c0b1-e279-424e-bc77-386bc0309eaa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033689 Aug 17 11:30:50.780609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 472/931] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:30:51.129125 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:51.129973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] [instance: 320e37a2-baf8-4abc-b621-77f4516606ae] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:51.138122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:51.138771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:51.139359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:51.140313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:51.140948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:51.141583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:51.157751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] HTTP exception thrown: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Request method failure captured: Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae HTTP/1.1 Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M_gkyb65EISayozDbDROlIHKhxrQ8Ze_7kU5Zg5GRl9ltH2FYNOJtzRuQ-Q_NhfDJ5hHgkrr8nhuMfvgwF8K5LXsjDVDgpwrTr62u5aWczJCzCj6v-a_5M4XQ2Oe6wYCeLLXnLW0LuN0-wM5mUO4n7yWxz5rGN8Kwo6lFOc78uEDgY Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: f442a74602f84e66a7615de64165786a Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-TestShelveInstance-538459944 Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:30:51.159299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f442a74602f84e66a7615de64165786a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f442a74602f84e66a7615de64165786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f442a74602f84e66a7615de64165786a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f442a74602f84e66a7615de64165786a", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-TestShelveInstance-538459944 Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: f442a74602f84e66a7615de64165786a Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-TestShelveInstance-538459944 Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-TestShelveInstance-538459944-project Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9fedc8ba1f054629b21407989ac53a44 Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-TestShelveInstance-538459944-project Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. Aug 17 11:30:51.160913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '320e37a2-baf8-4abc-b621-77f4516606ae'} Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:30:51.161952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. Aug 17 11:30:51.163511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:30:51.164900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Returning 404 to user: Instance 320e37a2-baf8-4abc-b621-77f4516606ae could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:30:51.164900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e56fdb5f-c6c2-47a2-b312-d299c5875ad3 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae" status: 404 len: 111 microversion: 2.1 time: 0.036990 Aug 17 11:30:51.164900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 460/932] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:30:51 2022] GET /compute/v2.1/servers/320e37a2-baf8-4abc-b621-77f4516606ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:30:51.330723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6d797f8d-d290-4ed2-8d5c-baded0338f97 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] Calling method '.version_select at 0x7f90440c30d0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:51.352576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6d797f8d-d290-4ed2-8d5c-baded0338f97 tempest-TestShelveInstance-538459944 tempest-TestShelveInstance-538459944-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1225781617" status: 202 len: 0 microversion: 2.1 time: 0.026420 Aug 17 11:30:51.353078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 473/933] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 17 11:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1225781617 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:30:51.518368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:51.518980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:51.525896 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:51.526381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:51.526808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:51.527503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:51.527954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:51.528380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:51.991321 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:52.000363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:52.002083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:52.003356 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b6d64e43-8760-4d09-95ea-b8bce5275621 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.489046 Aug 17 11:30:52.004171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 461/934] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:51 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:53.026259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:53.027004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:53.035366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:53.035919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:53.038057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:53.038057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:53.038057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:53.038057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:53.266539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:53.276248 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:53.277837 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:53.279280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-163699c2-1f45-4ba1-9497-519035074635 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1732 microversion: 2.20 time: 0.256841 Aug 17 11:30:53.280365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 474/935] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:53 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1732 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:30:54.302629 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:30:54.303246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:30:54.310239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:54.311004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:54.311611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:54.312323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:30:54.312778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:30:54.313201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:30:54.480524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:54.490545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:54.492209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:30:54.496835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-17edf288-f14c-4430-b3ed-7c248becea42 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1719 microversion: 2.20 time: 0.198164 Aug 17 11:30:54.501654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 462/936] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:30:54 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:31:04.934673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:04.935179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:04.937525 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:04.938165 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=28 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:04.944868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:04.945340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:04.945870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:04.946553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:04.947000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:04.947408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:04.972020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-28e8fad4-74d1-4508-afad-f2dc986cb27f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/ips" status: 200 len: 144 microversion: 2.1 time: 0.041606 Aug 17 11:31:04.972596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 475/937] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:31:04 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:31:07.098711 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13ca99c7-0d3c-478e-b356-d9c61cbf2b5e"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:31:07.101231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:07.104038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:07.104686 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=29 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:07.110491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:07.110970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:07.111395 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:07.112092 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:07.112537 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:07.112976 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:07.394192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9078e0cc-dee3-4244-9445-23a15f9024f3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299290 Aug 17 11:31:07.394800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 463/938] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:31:07 2022] POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:31:14.947714 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:31:14.954589 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:14.955080 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:14.955510 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:15.168631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Going to try to stop instance {{(pid=120583) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 11:31:15.216595 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c48c8cf0-3528-4237-8166-4523d15002ab tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action" status: 202 len: 0 microversion: 2.1 time: 0.272866 Aug 17 11:31:15.217194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 476/939] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:31:14 2022] POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:31:15.226641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:15.227347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:15.233787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:15.234374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:15.234951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:15.235713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:15.236237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:15.236780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:15.595509 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:15.604196 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bd5fa8a0-0455-42d1-af9e-92963a660e60 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.382187 Aug 17 11:31:15.604675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 464/940] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:15 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:16.630461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:16.631667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:16.642900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:16.643680 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:16.644428 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:16.645593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:16.646337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:16.647022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:16.784638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:16.796999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-39d192fb-fe9c-47fa-8c84-93d4de25f17d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.174108 Aug 17 11:31:16.797856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 477/941] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:16 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:17.823245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:17.824166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:17.835386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:17.836194 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:17.837143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:17.838369 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:17.839133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:17.839838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:17.980544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:17.992634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a47bff63-0a6e-46a1-9a32-8c27c845cad5 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.176197 Aug 17 11:31:17.993410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 465/942] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:17 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:19.019768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:19.020784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:19.029474 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:19.029987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:19.030418 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:19.031104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:19.031557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:19.031975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:19.224402 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:19.233237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-259e4857-37ba-4913-9098-c061db9a697a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.220042 Aug 17 11:31:19.233838 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 478/943] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:19 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:20.257998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:20.258878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:20.269824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:20.270638 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:20.271363 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:20.272503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:20.273282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:20.274042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:20.416498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:20.425019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-34d350f5-f046-4a8a-aff4-225c79664aa1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.173745 Aug 17 11:31:20.425634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 466/944] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:20 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:21.450909 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:21.451929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:21.462731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:21.463533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:21.464254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:21.465473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:21.466247 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:21.466953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:21.604068 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:21.612897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-da083582-32fe-42eb-bf83-e93d500a842a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.168650 Aug 17 11:31:21.613475 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 479/945] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:21 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:22.638790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:22.639727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:22.650596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:22.651283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:22.651719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:22.652437 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:22.652895 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:22.653315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:22.787417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:22.798464 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-15f2b192-1dda-432c-9015-35dabc08be8a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.165988 Aug 17 11:31:22.799158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 467/946] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:22 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:23.827557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:23.828509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:23.839190 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:23.839998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:23.840719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:23.841934 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:23.842701 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:23.843405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:23.985072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:23.995765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bf8c8f94-57c2-44e2-8d5d-fdf1c58e838e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.174956 Aug 17 11:31:23.996330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 480/947] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:23 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:25.018887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:25.019611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:25.028933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:25.029545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:25.030089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:25.030933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:25.031460 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:25.032051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:25.165767 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:25.173991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-da7f4690-e8eb-46b0-ae2b-c0c751d9fd11 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.159648 Aug 17 11:31:25.174532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 468/948] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:25 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:26.200515 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:26.201120 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:26.208758 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:26.209266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:26.209767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:26.210511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:26.210995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:26.211444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:26.346171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:26.354784 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b16f28b2-e242-4b14-97a0-5697950ac86d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.161288 Aug 17 11:31:26.355368 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 481/949] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:26 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:27.377823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:27.378663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:27.385168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:27.385780 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:27.386209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:27.386927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:27.387377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:27.387820 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:27.521382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:27.531860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-e6105eb2-0502-4b78-9f6c-86dfaf41b298 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.157979 Aug 17 11:31:27.532429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 469/950] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:27 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:28.452588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:31:28.453185 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:31:28.557552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:28.558556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:28.569516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:28.570310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:28.571046 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:28.572165 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:28.572901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:28.573640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:28.709908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:28.721975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e97878ae-dfe3-4c78-a907-7340cbca3535 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.170598 Aug 17 11:31:28.722761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 482/951] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:28 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:29.751394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:29.751978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:29.760561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:29.761063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:29.761530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:29.762236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:29.762698 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:29.763104 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:29.901005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:29.910464 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f53b999b-5054-400a-9db7-dae5d80b3844 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1722 microversion: 2.1 time: 0.165145 Aug 17 11:31:29.911239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 470/952] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:29 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:30.935652 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:30.936305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:30.943224 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:30.943710 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:30.944136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:30.944829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:30.945281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:30.945733 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:31.078076 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:31.086108 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a705ec48-25f6-4fd1-9c97-deddcdd0b9cc tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1699 microversion: 2.1 time: 0.154478 Aug 17 11:31:31.086856 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 483/953] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:30 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:31.106799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:31:31.113948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:31.114431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:31.114870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:31.175828 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Going to try to start instance {{(pid=120584) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 11:31:31.221725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4d698bee-6ec2-4b5e-857f-12e123cb9f89 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action" status: 202 len: 0 microversion: 2.1 time: 0.118796 Aug 17 11:31:31.222250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 471/954] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:31:31 2022] POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:31:31.230439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:31.231048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:31.237141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:31.237693 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:31.238119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:31.238799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:31.239239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:31.239650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:31.369968 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:31.378121 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-dfc3b9cb-d810-435a-8458-bdc8d7fc64d1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1708 microversion: 2.1 time: 0.151463 Aug 17 11:31:31.378721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 484/955] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:31 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:32.400939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:32.401681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:32.408863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:32.409341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:32.409808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:32.410495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:32.410947 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:32.411403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:32.552868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:32.563976 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d1459f4e-0a9f-4525-8351-234e70f6d361 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1708 microversion: 2.1 time: 0.167892 Aug 17 11:31:32.564547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 472/956] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:32 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:33.596131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:33.596736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:33.603266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:33.603753 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:33.604180 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:33.604861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:33.605312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:33.605760 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:33.744596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:33.753128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-abc82533-3d4f-427a-846d-ab733e1d0215 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1712 microversion: 2.1 time: 0.163397 Aug 17 11:31:33.753732 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 485/957] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:31:33 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:49.993523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:49.995788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:49.998014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=20 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:49.998671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:50.004210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.004701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.005133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.005859 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.006320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.006790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.042778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-20e00fee-1db4-4538-8ae8-4876d5acba3a tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053580 Aug 17 11:31:50.043337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 473/958] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 11:31:49 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:31:50.105070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:50.105640 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:50.108478 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=22 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:50.109131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:50.115420 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.115903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.116335 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.117026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.117498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.117931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.144271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:31:50.231965 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8ec5e3b8-c2fc-4de7-9759-201ccdecc573 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 204 len: 0 microversion: 2.20 time: 0.130609 Aug 17 11:31:50.232584 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 486/959] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 11:31:50 2022] DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 11:31:50.240913 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:50.241540 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:50.247643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.248056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.248506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.249180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:50.249693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:50.250105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:50.380022 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:50.388478 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:50.390057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:50.391199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-273c0ad2-a3a0-4916-95e2-e5d1915c1665 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.154246 Aug 17 11:31:50.391765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 474/960] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:50 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:31:51.419963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:51.421125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:51.430818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:51.431320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:51.431744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:51.432433 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:51.432887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:51.433306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:51.569966 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:51.578373 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:51.579857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:51.581021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-995ff479-baf8-4423-82c3-06c32c74310b tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.168514 Aug 17 11:31:51.581614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 487/961] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:51 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 11:31:52.604351 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:52.604939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:52.611593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:52.612042 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:52.612480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:52.613233 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:52.613713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:52.614138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:52.809458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:52.818257 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:52.819958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e6765845c4c4960bfee00c6384e8a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e247a3ec0a244abf9d11299cc53b9311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:31:52.821280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-53630422-c545-4da0-a30f-f5d35d93ea23 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 200 len: 1725 microversion: 2.20 time: 0.220993 Aug 17 11:31:52.822126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 475/962] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:52 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 11:31:53.240326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acde00db-f3f6-4404-a789-72b324341b43", "name": "network-vif-deleted", "tag": "4f3c9bf8-3c7c-48f9-be14-10b80dd2860a"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:31:53.251394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:53.251910 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:53.252334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:53.267235 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] Creating event network-vif-deleted:4f3c9bf8-3c7c-48f9-be14-10b80dd2860a for instance acde00db-f3f6-4404-a789-72b324341b43 on hv-cinder-85345 Aug 17 11:31:53.274625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a29057e3-26b6-41b6-973b-d399547f935f req-0a7a3277-80b8-4161-b785-4c37b021bfa0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039457 Aug 17 11:31:53.278429 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 488/963] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:31:53.844748 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:53.845394 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:53.856320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:53.857413 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:53.857893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:53.858604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:53.859283 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:53.859881 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:53.874287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 HTTP/1.1 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:31:53.876006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:53.877853 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'acde00db-f3f6-4404-a789-72b324341b43'} Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:31:53.878739 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:53.880323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:53.882431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:31:53.882431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-021eca63-f5fb-4d40-b08e-7f23d7d0a81d tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 404 len: 111 microversion: 2.20 time: 0.036705 Aug 17 11:31:53.882431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 476/964] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:53 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:31:53.887289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a48d8d9a-f8a1-41b6-9946-0758fc2efa86 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '.version_select at 0x7f904819f4c0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:53.912981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a48d8d9a-f8a1-41b6-9946-0758fc2efa86 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542589504" status: 204 len: 0 microversion: 2.20 time: 0.029771 Aug 17 11:31:53.913956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 489/965] 10.222.0.15 () {60 vars in 1262 bytes} [Wed Aug 17 11:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542589504 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 11:31:55.699217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:55.699741 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:55.706705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:55.707195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:55.707712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:55.708483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:55.708745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:55.709501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:55.726345 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 HTTP/1.1 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:31:55.727953 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.729802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'acde00db-f3f6-4404-a789-72b324341b43'} Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:31:55.730595 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.731804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.733008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:31:55.733008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c02c02ed-b651-4945-82ba-526839b637d3 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 404 len: 111 microversion: 2.20 time: 0.034081 Aug 17 11:31:55.733008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 477/966] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 11:31:55 2022] DELETE /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:31:55.739171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:55.739906 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: acde00db-f3f6-4404-a789-72b324341b43] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:55.746814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:55.747294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:55.747722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:55.748407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:55.748853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:55.749272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:55.762482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 HTTP/1.1 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:31:55.764097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.765840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'acde00db-f3f6-4404-a789-72b324341b43'} Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:31:55.766724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. Aug 17 11:31:55.768170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:55.769791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance acde00db-f3f6-4404-a789-72b324341b43 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:31:55.769791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d753e67d-38e7-44c2-889c-0e7b75a87876 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43" status: 404 len: 111 microversion: 2.20 time: 0.030942 Aug 17 11:31:55.769791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 490/967] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:55 2022] GET /compute/v2.1/servers/acde00db-f3f6-4404-a789-72b324341b43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:31:56.911002 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:56.911550 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:56.919434 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:56.919910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:56.920344 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:56.921044 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:56.921777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:56.922023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:56.935933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e HTTP/1.1 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:31:56.937530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.939238 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '76d1fb89-3bae-4f78-945d-175311eae82e'} Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:31:56.943771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.945640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.947192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:31:56.947192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6ee982b3-5f66-4e08-8129-3bf297b11405 tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 404 len: 111 microversion: 2.20 time: 0.032473 Aug 17 11:31:56.947192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 478/968] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 11:31:56 2022] DELETE /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:31:56.948658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:31:56.949275 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] [instance: 76d1fb89-3bae-4f78-945d-175311eae82e] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:31:56.956282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:56.956765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:56.957199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:56.957944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:31:56.958398 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:31:56.958816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:31:56.972146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] HTTP exception thrown: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Request method failure captured: Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e HTTP/1.1 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_M83PqJAQLntFHBebJg-jXA-L8GrRbgWdmY77JAJER6RMazgVcluaq3kKTOQziGiGsSVhjD6dD6Galvl62uOunHzblJE_r7vFyLYOUaUa3vBq1a4StxwqHyCLICbr-ssAJFcM9UTwbBBHgusijSrpaCguO6eaDXu1Rd2sAhcLsoU3uI Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:31:56.973775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e247a3ec0a244abf9d11299cc53b9311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e247a3ec0a244abf9d11299cc53b9311", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: e247a3ec0a244abf9d11299cc53b9311 Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-300889331 Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 1e6765845c4c4960bfee00c6384e8a4b Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeShelveTestJSON-300889331-project Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.975498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '76d1fb89-3bae-4f78-945d-175311eae82e'} Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:31:56.976406 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. Aug 17 11:31:56.977929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:31:56.979302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] Returning 404 to user: Instance 76d1fb89-3bae-4f78-945d-175311eae82e could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:31:56.979302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f77bc8be-ab56-4b11-938f-9dbbfe6c2c6c tempest-AttachVolumeShelveTestJSON-300889331 tempest-AttachVolumeShelveTestJSON-300889331-project] 10.222.0.15 "GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e" status: 404 len: 111 microversion: 2.20 time: 0.030799 Aug 17 11:31:56.979302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 491/969] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 11:31:56 2022] GET /compute/v2.1/servers/76d1fb89-3bae-4f78-945d-175311eae82e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:32:05.614546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-94c1c31f-b371-4729-985c-bf30c4227271 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: .version_select at 0x7f9044090040>, body: {"keypair": {"name": "tempest-keypair-1435529170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWUtBUv1r0/cDpy9B3HfWqMfB1W3RzSO1FkBRYqfet5s/qI+wWCD7GwSxkSu1ghxN4q2wMHGDO6EGgVhPQeNeNCWjBx/hOwPJIg3u2aWhiJbvQ5s+gP8zlfn8p+P+0xTQ=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:05.630433 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-94c1c31f-b371-4729-985c-bf30c4227271 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:32:05.634567 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-94c1c31f-b371-4729-985c-bf30c4227271 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:32:05.661296 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-94c1c31f-b371-4729-985c-bf30c4227271 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174575 Aug 17 11:32:05.661963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 479/970] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:32:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:32:06.910939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-232435577", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdce53ad-095c-4d85-9ac6-9bd34e30cbeb"}], "security_groups": [{"name": "tempest-securitygroup--1823439217"}], "key_name": "tempest-keypair-1435529170", "user_data": "}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:06.963609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:07.021993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] validate_networks() for [('bdce53ad-095c-4d85-9ac6-9bd34e30cbeb', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:32:07.430216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:32:07.430636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:32:07.431098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:32:07.431520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:32:07.432102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:32:07.442763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:07.443736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:07.444175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:07.444952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:07.445512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:07.445937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:07.463451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:32:07.467534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:32:07.478579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:32:07.480900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:32:07.529587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-25f8a233-c9d5-468a-a6e4-24161722e4ea tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623566 Aug 17 11:32:07.530724 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 492/971] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:32:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:32:07.539199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=24 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:07.543735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b0ba057c-41d0-4a1b-94ca-b363c33c8c65 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:07.544326 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b0ba057c-41d0-4a1b-94ca-b363c33c8c65 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:07.603671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b0ba057c-41d0-4a1b-94ca-b363c33c8c65 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:07.612768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b0ba057c-41d0-4a1b-94ca-b363c33c8c65 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1241 microversion: 2.1 time: 0.072890 Aug 17 11:32:07.625681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 480/972] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:07 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:08.633308 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:08.633989 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:08.641841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:08.642280 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:08.642748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:08.643431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:08.643941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:08.644359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:08.714627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:08.724945 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2ca52db2-fef5-4d05-960a-367c7603e044 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1293 microversion: 2.1 time: 0.096307 Aug 17 11:32:08.727109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 493/973] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:08 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:09.747907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:09.748463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:09.755297 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:09.755865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:09.756299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:09.756998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:09.757452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:09.757873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:09.977904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:09.985991 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0b1bffd0-7859-448e-af6d-d1f3b0f2335b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.242168 Aug 17 11:32:09.986573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 481/974] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:09 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:10.284261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c9ca99-0ecf-4de9-a6be-d1018f6d78d7", "tag": "626dbbf3-b6e3-4b68-8f94-85a0eb476df1"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:10.299507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:10.299981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:10.300401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:10.311769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] Creating event network-changed:626dbbf3-b6e3-4b68-8f94-85a0eb476df1 for instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 on hv-cinder-85345 Aug 17 11:32:10.317071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-d303daae-f1a0-4b70-a364-63c1554d6233 req-a08c0fb9-22c5-4774-886b-8d8695d1b5df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036319 Aug 17 11:32:10.317663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 494/975] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:32:11.011150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:11.011734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:11.018960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:11.019448 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:11.019892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:11.020582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:11.021037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:11.021459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:11.158384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:11.166374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a656759d-f312-4de5-9554-d3fcf7a742dc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.161508 Aug 17 11:32:11.166951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 482/976] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:11 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:12.191745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:12.192797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:12.202271 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:12.202958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:12.203572 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:12.204559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:12.205211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:12.205844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:12.339004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:12.347149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-26e07fc9-29df-482c-b3cb-b1331667ab4c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.162560 Aug 17 11:32:12.347721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 495/977] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:12 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:13.367765 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:13.368431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:13.375290 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:13.375776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:13.376202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:13.376907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:13.377381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:13.377856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:13.518191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:13.528190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7b7d2951-1c38-4b4a-9d2a-8a4ab3ce2d1d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.164277 Aug 17 11:32:13.528882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 483/978] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:13 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:14.554699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:14.555832 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:14.563800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:14.564289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:14.564720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:14.565408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:14.565896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:14.566316 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:14.701933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:14.710942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5787bf1b-a1b5-4b6c-b0e1-58ce424f93c8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.163230 Aug 17 11:32:14.711678 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 496/979] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:14 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:15.731239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:15.732445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:15.739164 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:15.739668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:15.740103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:15.740778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:15.741222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:15.741658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:15.876688 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:15.888171 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a58b5060-c6eb-49ee-82f0-d185e8df604a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.161098 Aug 17 11:32:15.888709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 484/980] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:15 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:16.912843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:16.913873 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:16.923720 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:16.924393 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:16.924983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:16.926078 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:16.926632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:16.927215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:17.073727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:17.081523 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1c1009a4-c264-4af9-b2dd-0a4b7593e6b8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.175354 Aug 17 11:32:17.082113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 497/981] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:16 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:17.128987 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c9ca99-0ecf-4de9-a6be-d1018f6d78d7", "name": "network-vif-plugged", "status": "completed", "tag": "626dbbf3-b6e3-4b68-8f94-85a0eb476df1"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:17.139332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:17.139851 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:17.140285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:17.151658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] Creating event network-vif-plugged:626dbbf3-b6e3-4b68-8f94-85a0eb476df1 for instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 on hv-cinder-85345 Aug 17 11:32:17.156992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-acc1dccc-642d-4818-af5c-9a7a024113a1 req-cde9f345-91bb-4a95-976f-a32a00856d1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031861 Aug 17 11:32:17.157766 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 485/982] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:32:18.103156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:18.103777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:18.105821 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:18.106499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:18.112901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:18.113381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:18.113822 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:18.114509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:18.114961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:18.115379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:18.251835 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:18.263114 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ca1ef0cb-e47b-4f52-825e-1cb4878c0863 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1367 microversion: 2.1 time: 0.163691 Aug 17 11:32:18.263852 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 498/983] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:18 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:19.288808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:19.289933 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:19.292821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:19.300736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:19.301201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:19.301679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:19.302384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:19.302833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:19.303255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:19.445743 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:19.457639 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c60802d2-8b5e-45ac-9790-6ed8daa5e2c6 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1558 microversion: 2.1 time: 0.175437 Aug 17 11:32:19.458388 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 486/984] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:19 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:19.483279 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:19.483811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:19.490635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:19.491122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:19.491556 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:19.492250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:19.492794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:19.493156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:19.570588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2a586f84-5831-4744-bf9c-71d02421a581 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091318 Aug 17 11:32:19.571182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 499/985] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:32:19 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:32:20.771751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c9ca99-0ecf-4de9-a6be-d1018f6d78d7", "tag": "626dbbf3-b6e3-4b68-8f94-85a0eb476df1"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:20.777996 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:20.781856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:20.782299 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:20.782742 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:20.794974 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] Creating event network-changed:626dbbf3-b6e3-4b68-8f94-85a0eb476df1 for instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 on hv-cinder-85345 Aug 17 11:32:20.800023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-2921c39a-6db5-4484-b88c-7768242631a7 req-8c4c976d-a6ed-41e4-a96e-50b00a896135 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Aug 17 11:32:20.800760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 487/986] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:32:37.085168 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:37.085986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=38 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:37.090131 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:37.090638 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:37.098137 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:37.098626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:37.099067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:37.099762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:37.100214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:37.100632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:37.188518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lazy-loading 'services' on Instance uuid e57c49bd-ede7-46e2-9c1a-9e6645f10e41 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:32:37.268752 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-45cd9b9c-505e-424a-a673-5fa7bdfcffed tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments/13ca99c7-0d3c-478e-b356-d9c61cbf2b5e" status: 202 len: 0 microversion: 2.1 time: 0.184880 Aug 17 11:32:37.269603 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 500/987] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:32:37 2022] DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments/13ca99c7-0d3c-478e-b356-d9c61cbf2b5e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:32:38.386089 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=34 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:38.386850 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:38.391811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:38.399105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:38.399636 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:38.400059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:38.422685 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Going to try to stop instance {{(pid=120584) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 11:32:38.477094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4ebfecff-605e-4339-b010-83d5e98d847f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action" status: 202 len: 0 microversion: 2.1 time: 0.092417 Aug 17 11:32:38.477778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 488/988] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:32:38 2022] POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:32:38.487293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:38.488024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:38.495553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:38.496061 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:38.496477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:38.497179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:38.497660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:38.498173 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:38.675013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:38.684737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a877d232-ef42-4aeb-a95f-7b2f6cdc1b9c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.201899 Aug 17 11:32:38.685583 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 501/989] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:38 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:39.710491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:39.711211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:39.718222 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:39.718702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:39.719134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:39.719845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:39.720284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:39.720705 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:39.853880 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:39.861385 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-35b16dfc-e3e5-4f19-a877-323ff5d3fa43 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.155739 Aug 17 11:32:39.861973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 489/990] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:39 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:40.885818 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:40.886473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:40.893827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:40.894612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:40.894768 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:40.895531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:40.896013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:40.896459 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:41.036139 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:41.044588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4cec28c3-7227-498b-922a-7b33186c4b9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.163876 Aug 17 11:32:41.044588 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 502/991] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:40 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:42.068576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:42.069596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:42.080320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:42.081114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:42.081882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:42.083013 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:42.083759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:42.084454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:42.224775 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:42.236516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3f4bd965-3529-460e-acb8-94f15d6976d3 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.174599 Aug 17 11:32:42.237377 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 490/992] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:42 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:43.262020 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:43.262631 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:43.270576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:43.271166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:43.271664 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:43.272469 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:43.272992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:43.273480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:43.406181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:43.414277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8c256a12-2120-4d0f-966a-b791951a71a6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.158690 Aug 17 11:32:43.414869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 503/993] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:43 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:44.439674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:44.440676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:44.451821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:44.452668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:44.453384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:44.454552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:44.455295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:44.455986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:44.597648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:44.607584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ea815ba2-4257-424b-a57e-f2820380fbf0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.174533 Aug 17 11:32:44.608154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 491/994] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:44 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:45.632971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:45.633961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:45.641363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:45.641886 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:45.642321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:45.643018 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:45.643473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:45.643896 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:45.775338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:45.783085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ffb84e8b-b922-47fa-8088-e6c434b067a0 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.156786 Aug 17 11:32:45.783655 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 504/995] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:45 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:46.808586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:46.809414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:46.818017 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:46.818620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:46.819158 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:46.820014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:46.820580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:46.821105 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:46.958484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:46.970093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b4495340-57d8-47bf-acf0-ffc99d79d33b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.167568 Aug 17 11:32:46.971004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 492/996] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:46 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:47.995397 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:47.996194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:48.004727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:48.005322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:48.005913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:48.006773 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:48.007338 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:48.007863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:48.152594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:48.160726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1cb66bf3-b5ac-4c95-832b-348ebc3d1f26 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1676 microversion: 2.1 time: 0.172121 Aug 17 11:32:48.161287 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 505/997] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:47 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:49.182546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:49.183419 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:49.190341 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:49.190829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:49.191261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:49.192342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:49.192781 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:49.193191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:49.326376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:49.334359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-29b95ba2-60eb-4944-a3fd-36c1c4d96b31 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1653 microversion: 2.1 time: 0.156152 Aug 17 11:32:49.334924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 493/998] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:49 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:49.357057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:32:49.364082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:49.364568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:49.365002 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:49.388537 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Going to try to start instance {{(pid=120583) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 11:32:49.436609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6628e064-b02c-46fd-85a8-ef4c25227f69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action" status: 202 len: 0 microversion: 2.1 time: 0.085393 Aug 17 11:32:49.437229 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 506/999] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 11:32:49 2022] POST /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:32:49.445943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:49.446536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:49.452921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:49.453456 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:49.453957 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:49.454722 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:49.455189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:49.455688 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:49.600778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:49.608889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-87c0b08c-bd7a-4f57-88b1-171eff607344 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1662 microversion: 2.1 time: 0.167213 Aug 17 11:32:49.609547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 494/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:49 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:50.636431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:50.637800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:50.645023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:50.645526 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:50.645946 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:50.646645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:50.647087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:50.647506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:50.782933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:50.790892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c81a982e-0f87-496b-b969-3c4ae5b99a7b tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1662 microversion: 2.1 time: 0.162574 Aug 17 11:32:50.791467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 507/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:50 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:32:51.815653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:32:51.816274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:32:51.824163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:51.824679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:51.825166 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:51.825973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:32:51.826482 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:32:51.826955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:32:51.962943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:32:51.973826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a71c10f0-d21b-471f-aa91-78831ac350d9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1666 microversion: 2.1 time: 0.163628 Aug 17 11:32:51.974620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 495/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:32:51 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:13.818006 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:33:13.819090 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:33:35.989170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:35.990085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:35.993504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=16 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:35.994454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:36.000920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:36.001458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:36.001875 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:36.002557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:36.003010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:36.003422 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:36.027912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-95ab4c59-1212-4b0a-8a98-95a28b49dee8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/ips" status: 200 len: 151 microversion: 2.1 time: 0.045642 Aug 17 11:33:36.028546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 508/1003] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:33:35 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:37.406333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "644328f5-ee6c-4ddc-be39-1c4f3bf16039"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:37.408730 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:37.411050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=16 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:37.411681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:37.417699 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:37.418178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:37.418602 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:37.419319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:37.419768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:37.420184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:37.741664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-173efeb1-0807-439b-b298-40c9a4556f27 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341245 Aug 17 11:33:37.744575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 496/1004] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:33:37 2022] POST /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:45.350577 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4d4bb52a-c6c8-4b03-837f-d9fdc390da58 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: .version_select at 0x7f9044072ca0>, body: {"keypair": {"name": "tempest-keypair-1946940996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmod7/fXSRLxR0bjSb1Vqala+XIRgR4rDL21J/Ta4B2ZHjuclQFozCXefQeYaDx2FGX9HU/eMNdnzDvYroh6Jl/j4GsgZtMacj3Ce/YT0mvz9RpHR/9xWgL6Mjz0K9pTg=="}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:45.367511 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-4d4bb52a-c6c8-4b03-837f-d9fdc390da58 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:33:45.371649 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-4d4bb52a-c6c8-4b03-837f-d9fdc390da58 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:33:45.396783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4d4bb52a-c6c8-4b03-837f-d9fdc390da58 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050184 Aug 17 11:33:45.397350 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 509/1005] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:33:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:46.900984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-804857674", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdce53ad-095c-4d85-9ac6-9bd34e30cbeb"}], "security_groups": [{"name": "tempest-securitygroup--1662048711"}], "key_name": "tempest-keypair-1946940996", "user_data": "}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:47.007295 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] validate_networks() for [('bdce53ad-095c-4d85-9ac6-9bd34e30cbeb', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:33:47.300953 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:47.306203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:47.308536 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:47.316744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.317362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.318233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.319172 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.319694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.320183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.350268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b91a9ef8-4920-41ad-a396-3a82ec6474a7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049877 Aug 17 11:33:47.351142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 510/1006] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:33:47 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:33:47.414004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:47.414495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:47.420913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.421069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.421445 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.422146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.422992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.423191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.452328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:33:47.452760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:33:47.453250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:33:47.453830 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:33:47.454070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:33:47.454315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:33:47.464133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.464693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.465134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.465903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.466487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.466921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.483958 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:33:47.488122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:33:47.500143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:33:47.502776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:33:47.538057 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ab57bf19-a975-464f-ae6f-f63c3e00e4ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 204 len: 0 microversion: 2.1 time: 0.126820 Aug 17 11:33:47.539107 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 511/1007] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:33:47 2022] DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:33:47.548227 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:47.548976 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:47.555985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-49699601-344c-46c8-9436-115197d813d4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659692 Aug 17 11:33:47.556641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 497/1008] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:33:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:33:47.557230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.557747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.558174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.558869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:47.559317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:47.559803 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:47.568547 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-dcfd36c1-2d4c-4b80-af15-a71a732299b0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:47.569189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-dcfd36c1-2d4c-4b80-af15-a71a732299b0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:47.630951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-dcfd36c1-2d4c-4b80-af15-a71a732299b0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:47.637887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-dcfd36c1-2d4c-4b80-af15-a71a732299b0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1241 microversion: 2.1 time: 0.074228 Aug 17 11:33:47.638650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 498/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:47 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:33:47.717596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:47.725365 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-244bd0e2-7595-4aa1-83e4-e108a8367d54 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1672 microversion: 2.1 time: 0.181464 Aug 17 11:33:47.725995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 512/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:47 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:33:48.663095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:48.664061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:48.675187 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:48.675966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:48.676674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:48.677845 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:48.678583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:48.679282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:48.743889 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:48.746405 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:48.747011 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:48.751601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b1ced5ca-bf48-4b9b-9f4f-1784772d6818 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1245 microversion: 2.1 time: 0.095152 Aug 17 11:33:48.752417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 499/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:48 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:48.753775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:48.754194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:48.754617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:48.755282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:48.755746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:48.756158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:48.896747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:48.907659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b6445776-c2eb-4bc0-9bd9-dde3423db288 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1672 microversion: 2.1 time: 0.165067 Aug 17 11:33:48.908263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 513/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:48 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:49.776701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:49.777736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:49.789004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:49.790024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:49.790759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:49.791905 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:49.792665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:49.793375 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:49.862710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:49.870927 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9a4d3a3b-9e21-46c5-994c-038a1f39d2a3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1293 microversion: 2.1 time: 0.100854 Aug 17 11:33:49.871475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 500/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:49 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:49.928451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:49.929024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:49.935594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:49.936071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:49.936495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:49.937176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:49.937659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:49.938071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:50.118765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:50.128763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6d6355ac-b272-4795-a5e9-4013bd7ed26c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1672 microversion: 2.1 time: 0.204106 Aug 17 11:33:50.142513 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 514/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:49 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:50.905819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:50.914843 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:50.927838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:50.929186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:50.929934 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:50.933191 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:50.934154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:50.934916 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.038876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57c49bd-ede7-46e2-9c1a-9e6645f10e41", "name": "network-vif-deleted", "tag": "fe3081f5-1d78-4d7e-a3cc-034734c85951"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:51.052774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:51.053633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:51.054550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.097306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] Creating event network-vif-deleted:fe3081f5-1d78-4d7e-a3cc-034734c85951 for instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 on hv-cinder-85345 Aug 17 11:33:51.127454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-40fffabd-bfd0-48c5-b39e-50d148cc4286 req-b9e70f8c-ff94-47c1-abc9-dd38fa0634f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228707 Aug 17 11:33:51.129505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 515/1015] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:51.152263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:51.153388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:51.162661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:51.163706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:51.164530 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.165580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:51.166268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:51.167160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.201840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:51.213355 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-38970144-00ca-467a-b555-00deac326cac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.316941 Aug 17 11:33:51.214342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 501/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:50 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:51.228780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:51.229812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:51.230473 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.231126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lazy-loading 'fault' on Instance uuid e57c49bd-ede7-46e2-9c1a-9e6645f10e41 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:33:51.289974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:51.298194 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7b6162b4-f05b-44d3-a4c9-048917067144 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 200 len: 1327 microversion: 2.1 time: 0.151622 Aug 17 11:33:51.299105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 516/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:51 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:33:51.800988 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6", "tag": "654cc283-f535-4caa-a95d-b194b3ac2ae0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:51.811004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:51.811509 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:51.811921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:51.824243 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] Creating event network-changed:654cc283-f535-4caa-a95d-b194b3ac2ae0 for instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 on hv-cinder-85345 Aug 17 11:33:51.829530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-786a705f-bfeb-46c0-bdde-5b7ad5de36b4 req-90e0d8ab-583a-474e-bc06-d224abca6163 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115313 Aug 17 11:33:51.830181 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 502/1018] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:52.237877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:52.238448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:52.247626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:52.248367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:52.248798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:52.249531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:52.249977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:52.250394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:52.320766 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:52.321454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:52.328454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:52.328959 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:52.329384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:52.330150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:52.330601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:52.331014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:52.344503 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 HTTP/1.1 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:33:52.346263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:33:52.347937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'e57c49bd-ede7-46e2-9c1a-9e6645f10e41'} Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:33:52.349085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:33:52.350761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:33:52.352387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:33:52.352387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ae80d40e-fbcc-4aa9-8efb-0336a777f923 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 404 len: 111 microversion: 2.1 time: 0.034857 Aug 17 11:33:52.352387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 503/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:52 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:33:52.359643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a4ac31e2-fb3d-413d-8193-d28f85f09165 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '.version_select at 0x7f90440efca0>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:52.380710 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a4ac31e2-fb3d-413d-8193-d28f85f09165 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935600662" status: 202 len: 0 microversion: 2.1 time: 0.024582 Aug 17 11:33:52.381310 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 504/1020] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:33:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935600662 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:33:52.401225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:52.408795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8d9a9b25-1739-47e4-a924-f0a8404e7a64 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.174886 Aug 17 11:33:52.409364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 517/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:52 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:53.007806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b1576039-c61c-4132-ae10-a252dcdd340a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: .version_select at 0x7f90440f7af0>, body: {"keypair": {"name": "tempest-keypair-711969746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs0bBIp3mDWc2zFWk8YYWd/k241RCGic8TzB2VGEIc7TxUIAjFGbKXe0X5qn1t2qmpKeFuTNzNRtKFR+HNTNxZKqz1aJJPnGP4ShpIZ9NR8RJmBcg6FJqSgooUbsQcKYw=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:53.024485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-b1576039-c61c-4132-ae10-a252dcdd340a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:33:53.028436 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-b1576039-c61c-4132-ae10-a252dcdd340a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for user 3a30088eecfc49de963e995292e58832 and project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:33:53.053732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b1576039-c61c-4132-ae10-a252dcdd340a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049877 Aug 17 11:33:53.054328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 505/1022] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:33:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:53.430688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:53.431289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:53.440083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:53.440578 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:53.441022 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:53.441761 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:53.442216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:53.443099 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:53.652643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:53.660918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-49b85b6f-eb70-4b41-acdb-0d8c5a284ca7 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.235024 Aug 17 11:33:53.661723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 518/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:53 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:54.479206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-398624461", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06bac9dc-dc7c-4653-af9c-5cd9b49c79f8"}], "security_groups": [{"name": "tempest-securitygroup--2034212651"}], "key_name": "tempest-keypair-711969746", "user_data": "}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:54.600417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] validate_networks() for [('06bac9dc-dc7c-4653-af9c-5cd9b49c79f8', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:33:54.682799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:54.683464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:54.690322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:54.691050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:54.691492 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:54.692203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:54.692975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:54.693554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:54.914827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:54.922439 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5e3aeb37-4c7e-4626-9c0e-2c560c9d176f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.243820 Aug 17 11:33:54.922994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 519/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:54 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:55.045303 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:33:55.045777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:33:55.046302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:33:55.046703 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:33:55.047112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:33:55.056944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:55.057444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:55.057890 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:55.058609 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:55.059057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:55.059476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:55.076470 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:33:55.080429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Getting quotas for user 3a30088eecfc49de963e995292e58832 and project 8ee10f3ae9d743dfa76c2679228e5818. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:33:55.091249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:33:55.093643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:33:55.143720 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0f62d68a-a90e-4b77-b66d-ae77c4faba3c tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.670163 Aug 17 11:33:55.144349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 506/1025] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:33:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:33:55.155635 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-83ee686a-ef9a-4ee3-9e49-3f01dab52366 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:55.156177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-83ee686a-ef9a-4ee3-9e49-3f01dab52366 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:55.214551 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-83ee686a-ef9a-4ee3-9e49-3f01dab52366 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:55.221663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-83ee686a-ef9a-4ee3-9e49-3f01dab52366 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1236 microversion: 2.1 time: 0.069970 Aug 17 11:33:55.222237 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 520/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:55 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:55.944055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:55.944702 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:55.952036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:55.952555 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:55.952984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:55.953712 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:55.954484 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:55.954973 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:56.095910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:56.103910 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b53f4d61-1421-4998-92b3-e83d9f2d82f9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.164733 Aug 17 11:33:56.104545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 507/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:55 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:56.242215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:56.243305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:56.253615 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:56.254494 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:56.255116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:56.255978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:56.256582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:56.257160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:56.326713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:56.335780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-cf734445-f3d2-4f7e-a9d8-eebae4b25ab1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1306 microversion: 2.1 time: 0.097640 Aug 17 11:33:56.336334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 521/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:56 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:57.124389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:57.124989 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:57.131733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.132180 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.132593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.133311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.133789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.134176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.268407 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:57.275981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3eda3a9a-6cbb-4813-8bf4-091be56bcff0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.155585 Aug 17 11:33:57.276559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 508/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:57 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:57.356539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:57.357293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:57.364617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.365345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.365811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.366527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.367059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.367488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.508728 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:57.516657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ca82119e-4d7a-4488-9285-7b018a4e6009 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.164220 Aug 17 11:33:57.517284 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 522/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:57 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:57.638328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfac7a19-3056-4179-bb23-46ec0b3c810f", "tag": "f921f85d-ac8d-43d9-92ca-a5207d472aa2"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:57.652193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.652838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.653400 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.665143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] Creating event network-changed:f921f85d-ac8d-43d9-92ca-a5207d472aa2 for instance dfac7a19-3056-4179-bb23-46ec0b3c810f on hv-cinder-85345 Aug 17 11:33:57.670901 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-c18820c6-61c8-4f99-b8ed-b9ea976e7647 req-cdc81dcc-9ab9-43a3-b1fb-cedc3464aafa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037548 Aug 17 11:33:57.671558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 509/1031] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:33:57.768500 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6", "name": "network-vif-plugged", "status": "completed", "tag": "654cc283-f535-4caa-a95d-b194b3ac2ae0"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:33:57.780001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:57.780574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:57.781694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:57.792879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] Creating event network-vif-plugged:654cc283-f535-4caa-a95d-b194b3ac2ae0 for instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 on hv-cinder-85345 Aug 17 11:33:57.798154 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-296d749c-d07b-4dd0-a680-e035e0f91f56 req-e7f8f472-711b-4249-9cae-56ed6d28b6e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089860 Aug 17 11:33:57.798783 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 523/1032] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:33:58.303085 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:58.304383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:58.315289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:58.315809 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:58.316244 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:58.316954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:58.317408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:58.318263 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:58.463382 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:58.474037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f9be0fec-32e8-4992-954f-628748c8ded5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.178276 Aug 17 11:33:58.474619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 510/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:58 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:58.540331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:58.541367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:58.550607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:58.551240 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:58.551814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:58.552706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:58.553354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:58.553870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:58.698658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:58.706438 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c91c4238-0423-4faf-b1b9-be580f526740 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.171870 Aug 17 11:33:58.707007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 524/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:58 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:59.499561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:59.500463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:59.511530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:59.512333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:59.513054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:59.514255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:59.515014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:59.515724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:59.660878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:59.673094 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-087588b9-29e4-4ecf-90a4-689b82d836f3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.179945 Aug 17 11:33:59.673861 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 511/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:59 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:33:59.728830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:33:59.729447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:33:59.736559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:59.737040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:59.737467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:59.738195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:33:59.738647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:33:59.739066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:33:59.870845 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:33:59.878543 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d85461d7-8acd-421d-bbe3-4f736631655a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.153618 Aug 17 11:33:59.879124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 525/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:33:59 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:00.698045 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:00.699084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:00.709937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:00.710741 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:00.711463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:00.712600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:00.713365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:00.714113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:00.847258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:00.855126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-48ba98f0-8bc3-4473-a4e1-c7cd9cb0d9cb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1367 microversion: 2.1 time: 0.164104 Aug 17 11:34:00.855701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 512/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:00 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:00.899483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:00.900130 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:00.907039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:00.907527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:00.907963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:00.908717 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:00.909178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:00.909649 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:01.042189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:01.045770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:34:01.050244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9f08374a-7d7d-4af7-8281-305fd0daa0af tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.154747 Aug 17 11:34:01.051024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 526/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:00 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:01.876269 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:01.876931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:01.883846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:01.884327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:01.884756 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:01.885486 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:01.885940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:01.886353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:02.031230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:02.039671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f641b6be-7b14-4810-b9c5-5b6700acafe3 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1557 microversion: 2.1 time: 0.167369 Aug 17 11:34:02.040230 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 513/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:01 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:02.060146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:02.060662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:02.070391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:02.070692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:02.071195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:02.071483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:02.071936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:02.072240 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:02.072427 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:02.072851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:02.078300 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:02.078783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:02.079211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:02.079896 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:02.080342 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:02.080754 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:02.178424 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-38079a25-20fc-481d-835d-fcac853e41e1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122259 Aug 17 11:34:02.179228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 527/1040] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:34:02 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:34:02.245603 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:02.253865 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b8812496-2342-43ec-abb6-83e8e0d27962 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.186474 Aug 17 11:34:02.254749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 514/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:02 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:03.275737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:03.276341 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:03.282409 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:03.282900 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:03.283330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:03.284023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:03.284496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:03.284886 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:03.369312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6", "tag": "654cc283-f535-4caa-a95d-b194b3ac2ae0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:34:03.379348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:03.379635 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:03.380055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:03.391496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] Creating event network-changed:654cc283-f535-4caa-a95d-b194b3ac2ae0 for instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 on hv-cinder-85345 Aug 17 11:34:03.396534 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-068e7545-4e44-4211-af5a-ae004c0a73c5 req-4f978b80-24c1-4767-8cdb-2bd22b6534f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030783 Aug 17 11:34:03.400496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 515/1042] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:34:03.433325 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:03.443097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-052ab59b-b6d6-45fd-b970-505f8f040f9a tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.171362 Aug 17 11:34:03.443694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 528/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:03 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:03.748109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfac7a19-3056-4179-bb23-46ec0b3c810f", "name": "network-vif-plugged", "status": "completed", "tag": "f921f85d-ac8d-43d9-92ca-a5207d472aa2"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:34:03.758673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:03.759228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:03.759956 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:03.773549 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] Creating event network-vif-plugged:f921f85d-ac8d-43d9-92ca-a5207d472aa2 for instance dfac7a19-3056-4179-bb23-46ec0b3c810f on hv-cinder-85345 Aug 17 11:34:03.778967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-f92ee9e8-506e-4be7-98b0-c9c9a4b049dd req-0694e752-f2a9-4e9b-b69c-16d0b812f27f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037338 Aug 17 11:34:03.779837 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 516/1044] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:34:04.465178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:04.465811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:04.473291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:04.474310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:04.475581 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:04.476512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:04.477010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:04.477376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:04.609827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:04.617558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6096ef28-1ae0-4e5b-a612-d79e13ed1f12 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.157495 Aug 17 11:34:04.618155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 529/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:04 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:05.639964 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=4 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:34:05.641193 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=18 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:34:05.646462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:05.647174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:05.654273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:05.654755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:05.655177 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:05.655862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:05.656315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:05.656735 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:05.792761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:05.800848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-af09f6a5-504b-4496-8f2b-f4e949d7c370 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1362 microversion: 2.1 time: 0.163473 Aug 17 11:34:05.801447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 517/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:05 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:06.824795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:06.825610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:06.828092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:34:06.829619 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:34:06.836066 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:06.836550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:06.836998 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:06.837722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:06.838174 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:06.838590 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:06.974674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:34:06.982820 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c53a75eb-bff5-4a78-8164-88efa982bdb7 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1547 microversion: 2.1 time: 0.163402 Aug 17 11:34:06.983391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 530/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:34:06 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:34:07.005102 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:34:07.005664 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:34:07.012473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:07.012952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:07.013379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:07.014107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:07.014559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:07.014981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:07.092168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-198922c4-21e1-4a5e-b17b-921548894585 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090567 Aug 17 11:34:07.093016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 518/1048] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:34:06 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:34:08.297679 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfac7a19-3056-4179-bb23-46ec0b3c810f", "tag": "f921f85d-ac8d-43d9-92ca-a5207d472aa2"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:34:08.307508 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:34:08.307983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:34:08.308407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:34:08.319765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] Creating event network-changed:f921f85d-ac8d-43d9-92ca-a5207d472aa2 for instance dfac7a19-3056-4179-bb23-46ec0b3c810f on hv-cinder-85345 Aug 17 11:34:08.324843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-261ec934-7ff6-472a-98d1-e045a4cb2539 req-15a48624-34ea-4a95-ba04-8c0bbf8b6ca8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Aug 17 11:34:08.325495 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 531/1049] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:18.426812 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:18.428021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:18.436055 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:18.436544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:18.445081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.445633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.446065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.446776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.447199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.447596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.473039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cfeafc99-f966-430f-ad55-3fb7b753dca5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.050249 Aug 17 11:35:18.473649 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 519/1050] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:35:18 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:18.484777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=3 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:18.485558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=24 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:18.490176 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "644328f5-ee6c-4ddc-be39-1c4f3bf16039"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:18.492626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:18.499840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.500312 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.500747 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.501449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.501935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.502346 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.582043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: POST /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/os-volume_attachments HTTP/1.1 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 74 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:18.583766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {"volumeAttachment": {"volumeId": "644328f5-ee6c-4ddc-be39-1c4f3bf16039"}} Aug 17 11:35:18.585560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'server_id': 'bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6', 'body': {'volumeAttachment': {'volumeId': '644328f5-ee6c-4ddc-be39-1c4f3bf16039'}}} Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:18.586488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:18.587775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 400 to user: Invalid volume: volume 644328f5-ee6c-4ddc-be39-1c4f3bf16039 is already attached to instances: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-bd99654b-348b-4efa-abe5-99c2cfc3262f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102738 Aug 17 11:35:18.589118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 532/1051] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:35:18 2022] POST /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:35:18.594719 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:18.595221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:18.601651 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.602135 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.602571 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.603249 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.603703 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.604122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.628882 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:35:18.707790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-13d6ae17-46c0-42a6-9445-b6eca71c2ab2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 204 len: 0 microversion: 2.1 time: 0.117135 Aug 17 11:35:18.708316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 520/1052] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:35:18 2022] DELETE /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:35:18.717152 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:18.718357 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:18.727233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.727723 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.728157 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.728857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:18.729309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:18.729769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:18.861748 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:18.869457 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7d4a3b76-c8ac-4299-9cb2-490582c37972 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1681 microversion: 2.1 time: 0.156260 Aug 17 11:35:18.870030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 533/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:18 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:19.895791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:19.896988 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:19.906604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:19.907087 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:19.907510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:19.908204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:19.908645 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:19.909061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:20.036440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:20.045312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c323b67e-bf51-46a1-a5ad-96df59ea4125 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1681 microversion: 2.1 time: 0.156807 Aug 17 11:35:20.045982 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 521/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:19 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:21.066135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:21.066685 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:21.073886 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:21.074377 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:21.074798 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:21.075498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:21.075950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:21.076390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:21.260222 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:21.267899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2fdeac81-9a9c-4dab-acc6-3bd2d127e954 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 200 len: 1681 microversion: 2.1 time: 0.205740 Aug 17 11:35:21.268458 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 534/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:21 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:21.596697 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6", "name": "network-vif-deleted", "tag": "654cc283-f535-4caa-a95d-b194b3ac2ae0"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:21.609928 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:21.610400 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:21.610813 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:21.623410 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] Creating event network-vif-deleted:654cc283-f535-4caa-a95d-b194b3ac2ae0 for instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 on hv-cinder-85345 Aug 17 11:35:21.629811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-ffedcc37-7440-4fd0-8a92-964cbacfd97f req-d1ef9a1e-eaea-4dd7-b74c-5310981548b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036674 Aug 17 11:35:21.630715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 522/1056] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:22.292003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:22.292576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:22.299482 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:22.299972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:22.300419 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:22.301113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:22.301603 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:22.302019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:22.315743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 HTTP/1.1 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:22.317266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:35:22.319102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6'} Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:22.319877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:35:22.321161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:22.322379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:22.322379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-25189540-726f-4e33-9ecb-b7213c06bcf9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 404 len: 111 microversion: 2.1 time: 0.031316 Aug 17 11:35:22.322379 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 535/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:22 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:22.328452 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cfee31ca-baf5-4d39-a4af-9bf8b75fbb9c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '.version_select at 0x7f90440f7940>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:22.354674 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cfee31ca-baf5-4d39-a4af-9bf8b75fbb9c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946940996" status: 202 len: 0 microversion: 2.1 time: 0.030326 Aug 17 11:35:22.355264 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 523/1058] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:35:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946940996 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:23.034956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:23.035451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:23.041575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.042058 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.042489 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.043185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.043636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.044049 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.126637 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lazy-loading 'services' on Instance uuid 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:35:23.203962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d42f1025-d471-41fe-b570-9e9542bd17c2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments/644328f5-ee6c-4ddc-be39-1c4f3bf16039" status: 202 len: 0 microversion: 2.1 time: 0.172907 Aug 17 11:35:23.204587 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 536/1059] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:35:23 2022] DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments/644328f5-ee6c-4ddc-be39-1c4f3bf16039 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:23.213723 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:23.216049 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:23.223188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.223875 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.224288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.225029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.225517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.225935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.257449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-85b13c05-39bf-47d1-a654-77eb8a281d0c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048220 Aug 17 11:35:23.258032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 524/1060] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:23 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:23.293834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:23.294411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:23.301268 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.301780 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.302234 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.302944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:23.303392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:23.303826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:23.327557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f6e41150-7c48-45cb-9b9a-1665681e441f tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/ips" status: 200 len: 144 microversion: 2.1 time: 0.092359 Aug 17 11:35:23.328036 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 537/1061] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:35:23 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/ips => generated 144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:24.269684 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:24.271761 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:24.278584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:24.279065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:24.279499 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:24.280186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:24.280640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:24.281059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:24.310589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ca2fe2e3-d4a6-4efc-97cf-40ba5e5e7186 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 17 11:35:24.311334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 525/1062] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:24 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:24.675344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b2665ad-95ca-40c0-8cc6-a4be4bc98b17"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:24.679961 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:24.687388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:24.687877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:24.688311 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:24.689012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:24.689504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:24.689929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:24.983726 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-27795c72-ee13-4141-8e8e-f904f755da44 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314955 Aug 17 11:35:24.984677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 538/1063] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:35:24 2022] POST /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:25.327744 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:25.330666 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:25.337454 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.337955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.338403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.339077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.339527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.339942 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.370501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d7afbbd7-4974-4ff2-bc5e-68ef9322ebe4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049390 Aug 17 11:35:25.371075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 526/1064] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:25 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:35:25.439192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:25.439901 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:25.450520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.451163 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.451790 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.452742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.453381 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.454044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.480927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:35:25.562288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-aee50b0b-1462-4dae-98ff-59e18f74af15 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 204 len: 0 microversion: 2.1 time: 0.129905 Aug 17 11:35:25.562993 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 539/1065] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:35:25 2022] DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:35:25.571963 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:25.572672 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:25.579009 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.579752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.580189 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.580893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:25.581359 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:25.581931 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:25.718335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:25.726431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f5810f30-36b3-447a-ad08-02ee84d6de07 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1683 microversion: 2.1 time: 0.159001 Aug 17 11:35:25.726967 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 527/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:25 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:26.753839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:26.754702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:26.763039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:26.763643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:26.764178 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:26.765508 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:26.766516 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:26.767480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:26.906369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:26.918106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-04db51f8-5431-4bd6-aec9-d323e79795fa tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1683 microversion: 2.1 time: 0.170619 Aug 17 11:35:26.918879 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 540/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:26 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:27.939789 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:27.940360 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:27.948400 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:27.948887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:27.949340 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:27.950132 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:27.950586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:27.951004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:28.155234 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:28.163228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b3128a24-5347-4e92-81e5-60c3c856fbae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1683 microversion: 2.1 time: 0.227587 Aug 17 11:35:28.163778 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 528/1068] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:27 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:28.804955 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c9ca99-0ecf-4de9-a6be-d1018f6d78d7", "name": "network-vif-deleted", "tag": "626dbbf3-b6e3-4b68-8f94-85a0eb476df1"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:28.815736 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:28.816238 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:28.816629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:28.828563 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] Creating event network-vif-deleted:626dbbf3-b6e3-4b68-8f94-85a0eb476df1 for instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 on hv-cinder-85345 Aug 17 11:35:28.834380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-acba0a69-95d5-49da-b41c-e6c7e0ff4450 req-44818dee-2f1b-4087-8862-008645e4ea6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Aug 17 11:35:28.834975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 541/1069] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:29.184725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:29.185516 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:29.193783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:29.194405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:29.194715 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:29.195630 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:29.195878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:29.196305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:29.229725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:29.230235 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:29.230673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:29.231124 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lazy-loading 'fault' on Instance uuid 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:35:29.282061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:29.292519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ae388aac-0d2e-4cae-8dee-d2c0e4380917 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 200 len: 1331 microversion: 2.1 time: 0.111799 Aug 17 11:35:29.293844 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 529/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:29 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:30.317988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:30.319053 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:30.325622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:30.326104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:30.326534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:30.327205 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:30.327657 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:30.328072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:30.341769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 HTTP/1.1 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:30.343632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:35:30.345269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '94c9ca99-0ecf-4de9-a6be-d1018f6d78d7'} Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:30.346622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:35:30.348141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:30.349718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:30.349718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d5b4aed3-ec1e-458a-9dd9-46bbfa9ab9a8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 404 len: 111 microversion: 2.1 time: 0.033024 Aug 17 11:35:30.349718 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 542/1071] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:30 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:30.354952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0cfa9577-e4ad-4013-a289-a16617b07c9a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '.version_select at 0x7f9044118d30>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:30.381401 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0cfa9577-e4ad-4013-a289-a16617b07c9a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435529170" status: 202 len: 0 microversion: 2.1 time: 0.030299 Aug 17 11:35:30.382016 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 530/1072] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:35:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435529170 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:31.015683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-94269d1f-f8b3-4dc3-9b67-efd781d8bab0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: .version_select at 0x7f904814d940>, body: {"keypair": {"name": "tempest-keypair-1185320808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF33VFvclYVt3kw6LnUBr0oetkO+PEYVvmU19JHLKnY/xbHhh0TpfG/16zpwA2JH6o29HZVnSIdN7YI6dZy2LCOS00flO0FZGIaV3vl7Zh73gLggHYgq7pDTXOy5Ir4Aiw=="}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:31.031070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-94269d1f-f8b3-4dc3-9b67-efd781d8bab0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:35:31.034992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-94269d1f-f8b3-4dc3-9b67-efd781d8bab0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:35:31.057967 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-94269d1f-f8b3-4dc3-9b67-efd781d8bab0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046274 Aug 17 11:35:31.058537 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 543/1073] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:35:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:32.313932 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1511941532", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdce53ad-095c-4d85-9ac6-9bd34e30cbeb"}], "security_groups": [{"name": "tempest-securitygroup--126574692"}], "key_name": "tempest-keypair-1185320808", "user_data": "}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:32.421260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] validate_networks() for [('bdce53ad-095c-4d85-9ac6-9bd34e30cbeb', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:35:32.810835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:35:32.811260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:35:32.811732 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:35:32.812143 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:35:32.812599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:35:32.822501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:32.822954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:32.823391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:32.824118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:32.824642 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:32.825192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:32.844008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:35:32.848117 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:35:32.860060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:35:32.862529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:35:32.914660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-015c75b5-47e3-47cf-898f-1bb8aacf253a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604954 Aug 17 11:35:32.915423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 531/1074] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:35:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:35:32.926854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-53492f90-3f82-48b6-a76a-797aed05057b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:32.927491 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-53492f90-3f82-48b6-a76a-797aed05057b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:32.983512 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-53492f90-3f82-48b6-a76a-797aed05057b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:32.991141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-53492f90-3f82-48b6-a76a-797aed05057b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1242 microversion: 2.1 time: 0.068852 Aug 17 11:35:32.991733 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 544/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:32 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:33.611075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:33.613716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:33.620935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:33.621450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:33.621898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:33.622631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:33.623114 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:33.623528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:33.652824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a13e068f-bcf3-4cc8-9101-c184b4e31e82 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Aug 17 11:35:33.653617 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 532/1076] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:33 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:33.663881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:33.664376 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:33.670586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:33.671070 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:33.671496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:33.672187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:33.672634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:33.673244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:33.701796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-70377a83-0710-4d40-ac72-4316facc623e tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17" status: 200 len: 194 microversion: 2.1 time: 0.041706 Aug 17 11:35:33.702353 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 545/1077] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 11:35:33 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:34.011566 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:34.012188 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:34.018579 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:34.019106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:34.019599 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:34.020346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:34.020804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:34.021227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:34.083887 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:34.092396 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-43d683fa-8e01-41cd-92bf-0272d30fa41b tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1294 microversion: 2.1 time: 0.084785 Aug 17 11:35:34.092975 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 533/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:34 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:35.038883 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b8e23e-9f49-4646-96a8-2e210091288b"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:35.041744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:35.048952 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:35.050050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:35.050565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:35.051451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:35.051913 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:35.052487 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:35.113816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:35.115235 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:35.122015 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:35.122576 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:35.123063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:35.123821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:35.124491 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:35.124753 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:35.328759 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-72385132-2491-4f58-895b-ba9f886e11e8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "POST /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294167 Aug 17 11:35:35.329363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 546/1079] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:35:35 2022] POST /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:35.369136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:35.377330 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-f5897690-0c6d-4741-8f38-2fcfe219b9d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.267555 Aug 17 11:35:35.393827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 534/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:35 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:35:35.705741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa3c246-901c-4d9c-b49e-0996f07c5f3d", "tag": "f94d28b6-51c9-4f67-a2b7-54482da349b8"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:35.718116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:35.718586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:35.718999 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:35.729668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] Creating event network-changed:f94d28b6-51c9-4f67-a2b7-54482da349b8 for instance daa3c246-901c-4d9c-b49e-0996f07c5f3d on hv-cinder-85345 Aug 17 11:35:35.734504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-d63ac43a-125b-47c0-b6cc-5fc5ff0a3a4f req-9f6eef2c-485d-410a-9986-aa6b3d1987a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039351 Aug 17 11:35:35.735081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 547/1081] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:35:36.398954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:36.399951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:36.407619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:36.408111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:36.408535 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:36.409210 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:36.409713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:36.410129 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:36.627527 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:36.635559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-587db224-8626-4985-9b98-c808ca81acf4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.240619 Aug 17 11:35:36.636150 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 535/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:36 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:37.661598 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:37.662421 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:37.670506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:37.671062 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:37.671559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:37.672352 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:37.672872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:37.673358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:37.694451 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:37.824770 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:37.832541 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8f70aac1-f6c9-4302-a48f-6d0a0991f31e tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.178265 Aug 17 11:35:37.833126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 548/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:37 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:38.859289 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:38.860037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:38.867023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:38.867515 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:38.867951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:38.868640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:38.869097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:38.869598 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:39.042641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:39.050811 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fc44ba8a-403e-4896-a4f0-975fa4ad4d48 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.195430 Aug 17 11:35:39.051379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 536/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:38 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:40.073594 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:40.074171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:40.080926 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:40.081404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:40.081853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:40.082527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:40.082987 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:40.083400 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:40.211498 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:40.219093 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-27506e75-28aa-4f13-8f71-20fece079cb1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.149740 Aug 17 11:35:40.219650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 549/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:40 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:41.243209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:41.243840 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:41.250832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:41.251323 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:41.251752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:41.252440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:41.252893 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:41.253309 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:41.257481 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:41.388528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:41.396558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-620bd7b5-2675-4414-b02e-3b9aa0c2f7a4 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.159083 Aug 17 11:35:41.397160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 537/1086] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:41 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:42.242358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa3c246-901c-4d9c-b49e-0996f07c5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "f94d28b6-51c9-4f67-a2b7-54482da349b8"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:42.252576 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:42.253015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:42.253579 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:42.266775 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] Creating event network-vif-plugged:f94d28b6-51c9-4f67-a2b7-54482da349b8 for instance daa3c246-901c-4d9c-b49e-0996f07c5f3d on hv-cinder-85345 Aug 17 11:35:42.271844 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-16e4c416-904d-4b2d-8e1e-126aa5749c9f req-fa98653e-b63d-4756-a7ee-1209f811b691 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Aug 17 11:35:42.272437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 550/1087] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:42.418583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:42.419199 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:42.426327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:42.426813 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:42.427250 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:42.428004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:42.428480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:42.428903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:42.611478 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:42.619745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5022b47e-ca15-4f8e-8b59-aee57b5f1ce2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.205761 Aug 17 11:35:42.620313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 538/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:42 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:42.900812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:42.903159 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:42.911483 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:42.912189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:42.912958 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:42.914179 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:42.914846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:42.915344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:42.946322 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-35cd5324-7e6b-4865-bcea-e726e8bc39ee tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051728 Aug 17 11:35:42.946908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 551/1089] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:42 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:43.097239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:43.097954 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:43.100405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:43.101288 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:43.109473 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.110151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.110727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.111615 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.112211 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.112769 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.143582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-01e4b42e-ceaa-4164-9a63-27cae3d22416 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17" status: 200 len: 194 microversion: 2.1 time: 0.051736 Aug 17 11:35:43.144127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 539/1090] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 11:35:43 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:43.154705 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:43.155183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:43.157126 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:43.162463 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.162936 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.163360 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.164039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.164484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.164899 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.251453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lazy-loading 'services' on Instance uuid dfac7a19-3056-4179-bb23-46ec0b3c810f {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:35:43.328298 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4bbefa4d-1fc9-467a-854f-f7f065bfb3c8 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17" status: 202 len: 0 microversion: 2.1 time: 0.177502 Aug 17 11:35:43.328881 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 552/1091] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:35:43 2022] DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/8b2665ad-95ca-40c0-8cc6-a4be4bc98b17 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:43.640403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:43.641065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:43.647679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.648269 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.648704 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.649381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:43.649860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:43.650280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:43.783911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:43.791542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-02ce806c-c44f-4527-9fb4-ac0c6a1248ef tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1367 microversion: 2.1 time: 0.155168 Aug 17 11:35:43.792120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 540/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:43 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:44.823294 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:44.824456 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:44.835195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:44.836039 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:44.836756 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:44.838075 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:44.838527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:44.838945 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:44.972161 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:44.979991 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1b5fcd3c-fc5e-446b-9b13-ce448bcd66d5 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1557 microversion: 2.1 time: 0.165119 Aug 17 11:35:44.980554 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 553/1093] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:44 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:45.000848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:45.001458 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:45.008538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.009062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.009669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.010636 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.011108 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.011548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.099583 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6a18a403-4e90-4a60-a5c6-3d66585cd781 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102950 Aug 17 11:35:45.100185 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 541/1094] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:35:44 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:45.515964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:45.516453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:45.522697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.523182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.523609 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.524317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.524762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.525199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.553957 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e1748333-24ff-4a35-855a-12fc829ad066 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/17b8e23e-9f49-4646-96a8-2e210091288b" status: 200 len: 194 microversion: 2.1 time: 0.042046 Aug 17 11:35:45.554737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 554/1095] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 11:35:45 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/17b8e23e-9f49-4646-96a8-2e210091288b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:45.565053 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:45.565545 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:45.571762 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.572432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.572681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.573349 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:45.573869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:45.574292 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:45.655693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lazy-loading 'services' on Instance uuid dfac7a19-3056-4179-bb23-46ec0b3c810f {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:35:45.732558 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-15f5a6bd-16c2-4ba8-91c1-f391de5e78b9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/17b8e23e-9f49-4646-96a8-2e210091288b" status: 202 len: 0 microversion: 2.1 time: 0.171229 Aug 17 11:35:45.733178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 542/1096] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:35:45 2022] DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments/17b8e23e-9f49-4646-96a8-2e210091288b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:46.033204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa3c246-901c-4d9c-b49e-0996f07c5f3d", "tag": "f94d28b6-51c9-4f67-a2b7-54482da349b8"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:46.043314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:46.043786 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:46.044212 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:46.055430 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] Creating event network-changed:f94d28b6-51c9-4f67-a2b7-54482da349b8 for instance daa3c246-901c-4d9c-b49e-0996f07c5f3d on hv-cinder-85345 Aug 17 11:35:46.060607 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-9d629bd4-391a-4530-92f0-9df467b14f56 req-d3000868-7fa3-4c61-8f7d-216f7c67c304 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031153 Aug 17 11:35:46.061197 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 555/1097] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:46.913408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:46.915783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:46.922200 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:46.922681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:46.923107 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:46.923798 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:46.924247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:46.924662 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:46.953952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-d8807db0-18de-4ead-bde3-c33677f872b1 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045303 Aug 17 11:35:46.954517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 543/1098] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:46 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:35:47.074995 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:47.077330 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:47.084088 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.084634 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.085063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.085799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.086244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.086625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.119942 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1b05db01-f6bc-44d2-b00f-d774d6632348 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051783 Aug 17 11:35:47.120487 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 556/1099] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:35:47 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:35:47.191696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:47.192195 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:47.198826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.199302 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.199752 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.200437 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.200919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.201339 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.225575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:35:47.306667 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c033937a-916a-4261-a32f-b2839d84e218 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 204 len: 0 microversion: 2.1 time: 0.118431 Aug 17 11:35:47.307174 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 544/1100] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:35:47 2022] DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:35:47.317166 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:47.317890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:47.324972 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.325505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.325937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.326617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:47.327063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:47.327479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:47.459265 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:47.467385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-654aa299-971f-4b47-93e8-89f13b2f82d6 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1671 microversion: 2.1 time: 0.154572 Aug 17 11:35:47.467986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 557/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:47 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:48.494770 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:48.495660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:48.497640 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:48.504584 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:48.505247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:48.505970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:48.506937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:48.507561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:48.508133 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:48.659489 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:48.670190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-57e79d85-c736-459e-9a5e-72132a3d9753 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1671 microversion: 2.1 time: 0.183052 Aug 17 11:35:48.670770 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 545/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:48 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:49.691843 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:49.692612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:49.695454 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:35:49.701083 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:49.701604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:49.702054 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:49.702755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:49.703220 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:49.703642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:50.193642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a30088eecfc49de963e995292e58832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee10f3ae9d743dfa76c2679228e5818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:35:50.201626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-26beaebc-aa43-4646-a4d5-19d7a8fa1ff9 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 200 len: 1671 microversion: 2.1 time: 0.513746 Aug 17 11:35:50.202189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 558/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:49 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 1671 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:35:50.642746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfac7a19-3056-4179-bb23-46ec0b3c810f", "name": "network-vif-deleted", "tag": "f921f85d-ac8d-43d9-92ca-a5207d472aa2"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:35:50.652731 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:50.653204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:50.653657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:50.665062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] Creating event network-vif-deleted:f921f85d-ac8d-43d9-92ca-a5207d472aa2 for instance dfac7a19-3056-4179-bb23-46ec0b3c810f on hv-cinder-85345 Aug 17 11:35:50.670050 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-ec78b932-2b1d-457c-a263-a42601b96ace req-39361601-d444-4ede-b7d3-a8a8121b2781 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030881 Aug 17 11:35:50.670749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 546/1104] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:35:51.223859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:51.224562 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:51.234272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:51.234774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:51.235211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:51.235927 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:51.236385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:51.236809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:51.253366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f HTTP/1.1 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:51.255118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:51.256692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'dfac7a19-3056-4179-bb23-46ec0b3c810f'} Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:51.261252 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:51.262834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:51.264223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:51.264223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-10185c4e-757e-49cf-9a98-b0bd8ff01987 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 404 len: 111 microversion: 2.1 time: 0.037355 Aug 17 11:35:51.264223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 559/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:51 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:51.266906 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-26acc307-a64d-4da0-9573-010e3800713d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '.version_select at 0x7f9044e74280>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:51.287728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-26acc307-a64d-4da0-9573-010e3800713d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711969746" status: 202 len: 0 microversion: 2.1 time: 0.025109 Aug 17 11:35:51.288332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 547/1106] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 11:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711969746 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:35:54.200413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:54.200916 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:54.207800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:54.208283 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:54.208711 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:54.209403 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:54.209903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:54.210324 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:54.223940 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f HTTP/1.1 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:54.225449 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.227029 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'dfac7a19-3056-4179-bb23-46ec0b3c810f'} Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:54.227950 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.229371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.230997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:54.230997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-34922bb3-2a95-440d-b8b4-488af86fdc69 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 404 len: 111 microversion: 2.1 time: 0.030426 Aug 17 11:35:54.230997 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 560/1107] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:35:54 2022] DELETE /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:54.235687 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:54.236459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: dfac7a19-3056-4179-bb23-46ec0b3c810f] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:54.243475 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:54.243968 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:54.244403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:54.245317 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:54.245815 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:54.246260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:54.260128 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f HTTP/1.1 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:35:54.261829 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.263522 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'dfac7a19-3056-4179-bb23-46ec0b3c810f'} Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:54.264532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. Aug 17 11:35:54.266120 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:54.267607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance dfac7a19-3056-4179-bb23-46ec0b3c810f could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:54.267607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7a1f1543-128a-48fc-8eb2-5a6638e5945d tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f" status: 404 len: 111 microversion: 2.1 time: 0.031724 Aug 17 11:35:54.267607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 548/1108] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:54 2022] GET /compute/v2.1/servers/dfac7a19-3056-4179-bb23-46ec0b3c810f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:55.415184 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:55.415802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:55.423136 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:55.423625 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:55.424059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:55.424755 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:55.425213 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:55.425673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:55.439558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 HTTP/1.1 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:35:55.441269 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.442750 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'e57c49bd-ede7-46e2-9c1a-9e6645f10e41'} Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:55.443892 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.445501 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.447100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:55.447100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ae17004e-29d8-4020-aa46-e66cdfc08ebe tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 404 len: 111 microversion: 2.1 time: 0.032132 Aug 17 11:35:55.447100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 561/1109] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:35:55 2022] DELETE /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:35:55.452480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:35:55.453113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] [instance: e57c49bd-ede7-46e2-9c1a-9e6645f10e41] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:35:55.459706 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:55.460197 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:55.460630 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:55.461315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:35:55.461805 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:35:55.462227 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:35:55.475504 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] HTTP exception thrown: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Request method failure captured: Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 HTTP/1.1 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NESVfKayINtBinUEsviRQj2ZRL-ASKZi-X4MsjvNz4wDYYWNT7rzZHWg8_SuKvWOf7zaGjAcZCxp15T2vGMalEAhx-6O89L002qDee-4BePPRlR5FWozQ_xjeezg05nL-T_8V1VeZgunsXdiRmMD1oKvboKaHNB_NYWr5JsDkqXH5U Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:35:55.477018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8ee10f3ae9d743dfa76c2679228e5818"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8ee10f3ae9d743dfa76c2679228e5818", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 8ee10f3ae9d743dfa76c2679228e5818 Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeTestJSON-255653616 Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 3a30088eecfc49de963e995292e58832 Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeTestJSON-255653616-project Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.478842 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'e57c49bd-ede7-46e2-9c1a-9e6645f10e41'} Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:35:55.479904 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. Aug 17 11:35:55.481531 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:35:55.483036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] Returning 404 to user: Instance e57c49bd-ede7-46e2-9c1a-9e6645f10e41 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:35:55.483036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-59a7f043-7596-4827-9a23-6aa857ed3995 tempest-AttachVolumeTestJSON-255653616 tempest-AttachVolumeTestJSON-255653616-project] 10.222.0.15 "GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41" status: 404 len: 111 microversion: 2.1 time: 0.029926 Aug 17 11:35:55.483036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 549/1110] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:35:55 2022] GET /compute/v2.1/servers/e57c49bd-ede7-46e2-9c1a-9e6645f10e41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:36:57.489374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=7 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:57.490216 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:57.674629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a36fc9cb-7d81-48bb-ae6a-738b63c31e36 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Action: 'create', calling method: .version_select at 0x7f904416fd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1696160650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzLyob4+ow2ANYaLsECryJqr7A6JdAlBISfipMRJ5CjphVCI9CrZfVJxOPl7T6oNrqkHQza4uXJNcAZ14kVp8y0qAE7dZnw5yasqRi0jlbwwYSEbpyXUooIwY9X1bhc4A=="}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:36:57.693116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-a36fc9cb-7d81-48bb-ae6a-738b63c31e36 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for project 17804d0c9bf140938c3f549444de03be. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:36:57.697627 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-a36fc9cb-7d81-48bb-ae6a-738b63c31e36 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for user e389e4bc234f4d5eb69b70eb7ffb6608 and project 17804d0c9bf140938c3f549444de03be. Resources: {'key_pairs'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:36:57.722358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a36fc9cb-7d81-48bb-ae6a-738b63c31e36 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.241440 Aug 17 11:36:57.722949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 562/1111] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:36:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:01.022069 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:01.022783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:01.027553 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:01.028047 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:01.039072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:01.039570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:01.040236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:01.041112 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:01.041596 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:01.042018 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:01.067456 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fe35dcaa-91db-44b8-9cea-8e4d43da95eb tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/ips" status: 200 len: 149 microversion: 2.1 time: 0.047475 Aug 17 11:37:01.068041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 550/1112] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:37:01 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:02.447299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba920806-536b-4654-985c-f89258f6079a"}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:02.456141 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:02.457185 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:02.457774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:02.458281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:02.459156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:02.459603 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:02.460021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:02.853830 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-20b46b31-3f91-40ea-b659-595ffeae60e2 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411439 Aug 17 11:37:02.854448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 563/1113] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:37:02 2022] POST /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:10.519533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba920806-536b-4654-985c-f89258f6079a"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:10.521938 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:10.528570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.529046 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.529476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.530173 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.530626 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.531073 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.667082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: POST /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments HTTP/1.1 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 74 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:37:10.668696 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {"volumeAttachment": {"volumeId": "ba920806-536b-4654-985c-f89258f6079a"}} Aug 17 11:37:10.670420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'server_id': 'daa3c246-901c-4d9c-b49e-0996f07c5f3d', 'body': {'volumeAttachment': {'volumeId': 'ba920806-536b-4654-985c-f89258f6079a'}}} Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:10.671485 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:10.673029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 400 to user: Invalid volume: volume ba920806-536b-4654-985c-f89258f6079a is already attached to instances: daa3c246-901c-4d9c-b49e-0996f07c5f3d {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-8fe428dc-a126-41ba-a7cb-081adca0d0fe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154770 Aug 17 11:37:10.674569 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 551/1114] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:37:10 2022] POST /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 11:37:10.732328 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=4 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:10.736668 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:10.737251 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:10.744299 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.744778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.745239 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.745959 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.746408 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.746828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.829920 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lazy-loading 'services' on Instance uuid daa3c246-901c-4d9c-b49e-0996f07c5f3d {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:37:10.910876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ae840b4a-292f-49b0-98a3-1dea66281e5c tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments/ba920806-536b-4654-985c-f89258f6079a" status: 202 len: 0 microversion: 2.1 time: 0.179785 Aug 17 11:37:10.911455 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 564/1115] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:37:10 2022] DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments/ba920806-536b-4654-985c-f89258f6079a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:37:10.920115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:10.922390 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:10.929287 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.929878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.930316 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.930997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:10.931463 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:10.931899 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:10.961075 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9e772903-cc33-419b-9a09-458592c219ac tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Aug 17 11:37:10.961634 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 552/1116] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:37:10 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:37:11.974206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:11.976531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:11.983359 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:11.983869 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:11.984362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:11.985050 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:11.985517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:11.985935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:12.014841 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-53b8d814-721e-4408-abf8-93ca744a3aa8 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044986 Aug 17 11:37:12.015385 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 565/1117] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:37:11 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:37:12.077443 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:12.077924 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:12.084848 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:12.085327 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:12.085907 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:12.086592 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:12.087040 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:12.087455 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:12.112336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:37:12.195147 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-12851902-5bf3-40b6-b276-024031878a31 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 204 len: 0 microversion: 2.1 time: 0.121220 Aug 17 11:37:12.195849 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 553/1118] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:37:12 2022] DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:37:12.205103 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:12.206007 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:12.212032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:12.212496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:12.212962 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:12.213676 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:12.214118 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:12.214532 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:12.345574 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:12.353800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-887c7088-83b9-495e-8de7-6e445eac7680 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1681 microversion: 2.1 time: 0.152788 Aug 17 11:37:12.354382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 566/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:12 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:13.380347 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:13.381532 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:13.392148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:13.392633 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:13.393066 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:13.393796 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:13.394255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:13.394673 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:13.525835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:13.533821 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-46b79320-4be7-43e8-8588-241234d59531 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1681 microversion: 2.1 time: 0.160693 Aug 17 11:37:13.534368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 554/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:13 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:14.559351 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:14.560354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:14.569146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:14.569671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:14.570104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:14.570791 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:14.571253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:14.571672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:14.706437 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:14.714348 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-0f69dd29-7a15-4695-8437-4aab2f5be167 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1681 microversion: 2.1 time: 0.161617 Aug 17 11:37:14.714925 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 567/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:14 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:15.659423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa3c246-901c-4d9c-b49e-0996f07c5f3d", "name": "network-vif-deleted", "tag": "f94d28b6-51c9-4f67-a2b7-54482da349b8"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:15.670790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:15.671267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:15.671695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:15.684981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] Creating event network-vif-deleted:f94d28b6-51c9-4f67-a2b7-54482da349b8 for instance daa3c246-901c-4d9c-b49e-0996f07c5f3d on hv-cinder-85345 Aug 17 11:37:15.691500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-f2b0dfec-875b-4242-b32a-abd8218373ef req-de76a348-0cd9-4db4-b68d-0bc1c6e12850 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035175 Aug 17 11:37:15.692109 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 555/1122] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:15.735868 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:15.736804 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:15.748698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:15.749522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:15.750177 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:15.751677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:15.752304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:15.753049 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:15.831553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:15.840431 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-371564ab-ea7c-45dd-8d6f-a9c3a0374413 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 200 len: 1327 microversion: 2.1 time: 0.109008 Aug 17 11:37:15.841016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 568/1123] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:15 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:16.867799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:16.868966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:16.879041 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:16.879526 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:16.879960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:16.880660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:16.881111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:16.881575 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:16.895391 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d HTTP/1.1 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:37:16.897024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:37:16.898582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'daa3c246-901c-4d9c-b49e-0996f07c5f3d'} Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:37:16.899653 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:37:16.901620 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:37:16.903716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:37:16.903716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-56a77340-921b-4ad9-9255-95b544b83b3d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 404 len: 111 microversion: 2.1 time: 0.037767 Aug 17 11:37:16.903716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 556/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:16 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:37:16.908262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-eebeb272-7252-47b3-86c8-9c2adca3ae32 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '.version_select at 0x7f90440a31f0>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:16.931115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-eebeb272-7252-47b3-86c8-9c2adca3ae32 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185320808" status: 202 len: 0 microversion: 2.1 time: 0.027322 Aug 17 11:37:16.931666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 569/1125] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:37:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185320808 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:37:17.555179 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b4588b0d-ec9d-4f7e-95b7-2721369b37d0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: .version_select at 0x7f90440efb80>, body: {"keypair": {"name": "tempest-keypair-1800998990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjCL2UhynxZjlxPEOhRWThWf4wdtpuld8N0Z+dG1nMSlEEgrqTVNGbXja1hi45BWYxV7Lsp5l6oPml/cOQDs2jY6vaYYQzC+CwHj89KeJmr2r4KRcd6udkUq62icEH7yQ=="}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:17.572772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-b4588b0d-ec9d-4f7e-95b7-2721369b37d0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:37:17.577986 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-b4588b0d-ec9d-4f7e-95b7-2721369b37d0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'key_pairs'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:37:17.606447 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b4588b0d-ec9d-4f7e-95b7-2721369b37d0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055424 Aug 17 11:37:17.607054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 557/1126] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 11:37:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:18.864521 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-214072328", "imageRef": "82e8e712-f9a9-457f-866c-c3a0db712b6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdce53ad-095c-4d85-9ac6-9bd34e30cbeb"}], "security_groups": [{"name": "tempest-securitygroup--1882866482"}], "key_name": "tempest-keypair-1800998990", "user_data": "}} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:18.972713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.network.neutron [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] validate_networks() for [('bdce53ad-095c-4d85-9ac6-9bd34e30cbeb', None, None, None, None, None)] {{(pid=120583) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:37:19.445505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:37:19.446003 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image limits 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:37:19.446479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Flavor pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:37:19.446874 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Image pref 0:0:0 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:37:19.447275 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.virt.hardware [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120583) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:37:19.456189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:19.456702 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:19.457121 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:19.457875 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:19.458320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:19.458721 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:19.462505 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-667429421", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1696160650", "security_groups": [{"name": "tempest-secgroup-smoke-470505449"}], "block_device_mapping_v2": [{"uuid": "f99af1de-77c0-4f47-845c-eb317b77c1f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93282624-776f-4cbf-a67b-19d0ed326f7b"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:19.476898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:37:19.481084 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.quota [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Getting quotas for user 9930ab5b9ede4451b681ef1ecec0605f and project 044cb22f85a04a4b9f56e7b48c7b40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=120583) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:37:19.492974 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Going to run 1 instances... {{(pid=120583) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:37:19.495334 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82e8e712-f9a9-457f-866c-c3a0db712b6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120583) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:37:19.544209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [0b474063-c18c-4a08-bc74-8748880adfe9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 11:37:19.596032 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] validate_networks() for [('93282624-776f-4cbf-a67b-19d0ed326f7b', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:37:19.969658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:37:19.970324 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:37:19.971081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:37:19.971643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:37:19.972206 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:37:19.986095 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:19.986810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:19.987480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:19.988279 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:19.988728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:19.989139 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:20.006515 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:37:20.010835 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for user e389e4bc234f4d5eb69b70eb7ffb6608 and project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:37:20.072827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:37:20.075063 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f99af1de-77c0-4f47-845c-eb317b77c1f6',volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:37:20.217213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-82e48b1e-2dde-47d4-83dc-f51f45cf994f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758716 Aug 17 11:37:20.217886 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 558/1127] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:37:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:37:20.228833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-14982440-2446-45ab-8807-16d1754ef959 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:20.229449 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-14982440-2446-45ab-8807-16d1754ef959 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:20.287563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-14982440-2446-45ab-8807-16d1754ef959 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:20.294517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-14982440-2446-45ab-8807-16d1754ef959 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1094 microversion: 2.1 time: 0.069417 Aug 17 11:37:20.295078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 559/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:20 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:20.553069 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [0b474063-c18c-4a08-bc74-8748880adfe9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 48258. Aug 17 11:37:20.557337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c2247564-918d-496c-8bf0-341a601ba601 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.697944 Aug 17 11:37:20.558063 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 570/1129] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:37:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:37:20.574707 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ccb5bd9d-aab7-4447-9357-1595e5824bbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:20.576291 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ccb5bd9d-aab7-4447-9357-1595e5824bbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:20.648978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ccb5bd9d-aab7-4447-9357-1595e5824bbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:20.658911 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ccb5bd9d-aab7-4447-9357-1595e5824bbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1241 microversion: 2.1 time: 0.092832 Aug 17 11:37:20.659972 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 560/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:20 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:21.316323 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:21.316943 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:21.324266 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:21.324754 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:21.325192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:21.325931 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:21.326384 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:21.326808 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:21.390939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:21.403708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-1d71885e-06fb-4d47-9c05-2c1c33cff7a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1192 microversion: 2.1 time: 0.091206 Aug 17 11:37:21.413550 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 571/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:21 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:21.683863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:21.684929 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:21.696207 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:21.696992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:21.697773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:21.699061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:21.699806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:21.700542 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:21.777115 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:21.785123 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-235b72f4-51b1-43e5-b1a0-30c3fe4851bf tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1293 microversion: 2.1 time: 0.107837 Aug 17 11:37:21.786197 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 561/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:21 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:22.431904 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:22.432514 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:22.444696 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:22.445189 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:22.445659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:22.446481 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:22.446940 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:22.447363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:22.542773 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:22.552314 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a3ca3220-8fb0-4f31-88cb-a57d9ee7daf6 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1210 microversion: 2.1 time: 0.131740 Aug 17 11:37:22.553480 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 572/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:22 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:22.809364 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:22.810984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:22.820598 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:22.821501 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:22.822172 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:22.823111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:22.823776 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:22.825409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:23.093635 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:23.103646 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b9d7b92a-8c1e-4dae-bcf0-8ed0a73ded42 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.300228 Aug 17 11:37:23.104424 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 562/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:22 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:23.456773 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b2248f-a334-4863-99c7-efb97e83d5ba", "tag": "65ef96ca-0c10-4f62-83ef-7fac5c43a6ad"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:23.470215 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:23.470691 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:23.471261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:23.483169 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] Creating event network-changed:65ef96ca-0c10-4f62-83ef-7fac5c43a6ad for instance 53b2248f-a334-4863-99c7-efb97e83d5ba on hv-cinder-85345 Aug 17 11:37:23.488320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-13eee466-4cee-479f-ba4e-ee4d9224a549 req-6a827902-dfb8-4f24-ab1e-67cd0b4350f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038127 Aug 17 11:37:23.489282 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 573/1135] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:23.574367 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:23.575353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:23.581554 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:23.582037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:23.582539 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:23.583271 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:23.583721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:23.584138 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:23.648858 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b352c5-b940-4bfa-a497-ea918fa806db", "tag": "4e6f2c18-5523-41cf-ab32-b20ae8258d85"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:23.661941 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:23.662766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:23.663095 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:23.675030 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] Creating event network-changed:4e6f2c18-5523-41cf-ab32-b20ae8258d85 for instance c4b352c5-b940-4bfa-a497-ea918fa806db on hv-cinder-85345 Aug 17 11:37:23.680250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-221ceef5-195f-43b8-b595-416a6d5ec4a9 req-fbf3dcaa-5a7b-469d-976b-bb2be7d253e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036906 Aug 17 11:37:23.681142 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 574/1136] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:37:23.783237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:23.791353 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-17a5965c-3f38-41b6-a48c-3c14ecc4b5ff tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.220945 Aug 17 11:37:23.791817 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 563/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:23 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:37:24.129155 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:24.129887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:24.136517 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:24.137004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:24.137453 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:24.138158 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:24.138611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:24.139031 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:24.273339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:24.281119 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-f086f1cb-1702-40da-8021-5f21018ae085 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.158909 Aug 17 11:37:24.281767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 575/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:24 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:24.812624 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:24.813265 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:24.820462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:24.820948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:24.821643 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:24.822348 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:24.822803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:24.823357 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:25.016242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:25.029319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-450d1391-b137-4cea-bcf2-90a5e5e9ada1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.220829 Aug 17 11:37:25.029950 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 564/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:24 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:25.304257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:25.304898 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:25.311729 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:25.312206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:25.312630 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:25.313311 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:25.313793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:25.314211 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:25.453659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:25.461339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8e7a645f-cad5-4fe7-bfad-3f2d6944ff37 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.162038 Aug 17 11:37:25.461949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 576/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:25 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:26.054334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:26.055334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:26.066260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:26.067051 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:26.067757 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:26.069274 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:26.070695 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:26.071498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:26.213603 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:26.225078 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-230969b4-d8fd-4aaf-9a1c-ed1e333bab8f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.177341 Aug 17 11:37:26.225951 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 565/1141] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:26 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:26.485994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:26.486860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:26.497929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:26.498697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:26.499418 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:26.500553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:26.501290 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:26.502032 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:26.640663 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:26.649738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e7216703-bf62-44be-9f7a-23bfc12b1dbc tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.170384 Aug 17 11:37:26.650306 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 577/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:26 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:27.246259 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:27.247010 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:27.253824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:27.254376 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:27.254909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:27.255627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:27.256077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:27.256497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:27.393724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:27.401502 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cb24f74a-36eb-4b05-895d-9e686760a267 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.159124 Aug 17 11:37:27.402265 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 566/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:27 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:27.672204 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:27.672994 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:27.676183 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:27.682504 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:27.682990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:27.683424 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:27.684122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:27.684552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:27.685013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:27.688304 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:27.816101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:27.824104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a497127d-fcf7-4c56-8f24-a17b34bd44ae tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.156863 Aug 17 11:37:27.824671 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 578/1144] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:27 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:28.427137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:28.428444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:28.436346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:28.437179 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:28.437651 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:28.438362 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:28.438818 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:28.439245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:28.576935 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:28.584563 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0f72a80e-8f81-48db-9eaa-5ff8b0bf908e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.164142 Aug 17 11:37:28.585136 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 567/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:28 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:28.844467 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:28.845028 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:28.851932 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:28.852411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:28.852834 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:28.853546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:28.854012 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:28.854401 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:28.991223 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:28.999109 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-47036458-9bf2-4070-92d6-a3e5624993a1 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.158659 Aug 17 11:37:28.999674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 579/1146] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:28 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:29.606269 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:29.606864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:29.614137 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:29.614641 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:29.615093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:29.615985 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:29.616429 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:29.617132 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:29.756826 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:29.764613 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-18ead1d1-a97a-4db2-bf31-3229718fb872 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.162563 Aug 17 11:37:29.765178 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 568/1147] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:29 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:30.023656 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:30.024908 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:30.027855 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:30.028929 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=6 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:30.039628 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:30.040113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:30.040522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:30.041447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:30.041915 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:30.042331 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:30.176450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:30.184293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5c8008ad-8405-4452-a691-8b92737b698a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.167379 Aug 17 11:37:30.184857 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 580/1148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:30 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:30.613713 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b352c5-b940-4bfa-a497-ea918fa806db", "name": "network-vif-plugged", "status": "completed", "tag": "4e6f2c18-5523-41cf-ab32-b20ae8258d85"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:30.618939 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:30.625519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:30.626035 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:30.626423 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:30.637922 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] Creating event network-vif-plugged:4e6f2c18-5523-41cf-ab32-b20ae8258d85 for instance c4b352c5-b940-4bfa-a497-ea918fa806db on hv-cinder-85345 Aug 17 11:37:30.643021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-94697530-0e05-4bc7-acfb-f56c99d9d81f req-38773a43-809f-421d-ac58-70740c7736d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Aug 17 11:37:30.643774 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 569/1149] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:30.785333 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:30.785990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:30.792479 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:30.792967 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:30.793404 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:30.794154 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:30.794639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:30.795067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:30.939546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:30.948552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-81e07685-8e88-4b8d-8c5e-a949da6e5c9f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.167114 Aug 17 11:37:30.949336 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 581/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:30 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:31.204159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=14 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:31.208884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:31.209690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:31.211477 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:31.217383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:31.217891 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:31.218328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:31.219011 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:31.219462 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:31.219884 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:31.223446 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:37:31.353665 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:31.361593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-db2a59c8-5a73-40a2-a6ed-4b137dea0419 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.158323 Aug 17 11:37:31.362149 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 570/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:31 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:31.974044 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:31.975060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:31.986210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:31.987067 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:31.987793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:31.988944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:31.989765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:31.990520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:32.122004 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:32.130087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c0fef3e7-f001-4967-83cc-57a5ae85b55f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.162609 Aug 17 11:37:32.130654 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 582/1152] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:31 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:32.384768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:32.385403 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:32.392389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:32.392876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:32.393318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:32.394190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:32.394650 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:32.395072 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:32.529771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:32.537969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ca5bfd4c-384e-434d-bfc1-bb0ea369b3c9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1367 microversion: 2.1 time: 0.157949 Aug 17 11:37:32.538536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 571/1153] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:32 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:33.153051 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:33.153859 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:33.162694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.163214 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.163642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.164337 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.164787 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.165217 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.298975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:33.307146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-832c8e44-0890-4f31-af93-3af4f1743b19 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.159246 Aug 17 11:37:33.307727 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 583/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:33 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:33.563335 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:33.564217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:33.575450 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.576252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.576981 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.578186 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.578943 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.579652 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.724474 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:33.735843 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3967aa9b-12b4-44c4-85c0-25459248164d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1558 microversion: 2.1 time: 0.179082 Aug 17 11:37:33.736690 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 572/1155] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:33 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:33.765604 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:33.766105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:33.774448 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.774937 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.775371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.776061 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:33.776645 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:33.777349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:33.860963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-82e005c3-aee0-4e30-be62-bbd9fd272395 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100407 Aug 17 11:37:33.861575 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 584/1156] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 11:37:33 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:34.328005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:34.328616 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:34.334759 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:34.335251 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:34.335685 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:34.336444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:34.336903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:34.337311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:34.468492 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:34.476182 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4b00a2c7-fd52-4931-9c2d-19378281a73f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.152168 Aug 17 11:37:34.476824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 573/1157] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:34 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:34.635774 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b2248f-a334-4863-99c7-efb97e83d5ba", "name": "network-vif-plugged", "status": "completed", "tag": "65ef96ca-0c10-4f62-83ef-7fac5c43a6ad"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:34.647407 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:34.647877 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:34.648292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:34.660776 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] Creating event network-vif-plugged:65ef96ca-0c10-4f62-83ef-7fac5c43a6ad for instance 53b2248f-a334-4863-99c7-efb97e83d5ba on hv-cinder-85345 Aug 17 11:37:34.665903 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-a08a93a1-fb09-4df5-86bf-32ac408e380c req-69d35494-b098-4be4-877a-bc4855f8a9b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034235 Aug 17 11:37:34.666806 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 585/1158] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:34.862037 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b352c5-b940-4bfa-a497-ea918fa806db", "tag": "4e6f2c18-5523-41cf-ab32-b20ae8258d85"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:34.873062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:34.873582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:34.874038 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:34.885814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] Creating event network-changed:4e6f2c18-5523-41cf-ab32-b20ae8258d85 for instance c4b352c5-b940-4bfa-a497-ea918fa806db on hv-cinder-85345 Aug 17 11:37:34.891791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-1c31c938-add3-46e1-8a4d-48d868a675d6 req-8f1b0879-9082-4c8b-b5b8-af51efc8bfd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Aug 17 11:37:34.892460 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 574/1159] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:37:35.497785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:35.498647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:35.505665 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:35.506028 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:35.506475 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:35.507175 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:35.507797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:35.508372 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:35.648281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:35.656390 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-62457026-0cb4-4baa-821b-193c5f6fd93a tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1265 microversion: 2.1 time: 0.163152 Aug 17 11:37:35.656939 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 586/1160] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:35 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:36.678029 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:36.678733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:36.685669 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:36.686160 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:36.686593 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:36.687308 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:36.687823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:36.688226 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:36.827873 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:36.835823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-da299cc6-7484-4246-812a-bfc642479d1f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1453 microversion: 2.1 time: 0.162671 Aug 17 11:37:36.836393 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 575/1161] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:36 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:36.855986 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:37:36.856599 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:37:36.863219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:36.863687 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:36.864115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:36.864799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:36.865249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:36.865731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:37.004106 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:37:37.012789 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-a330fc9f-70a4-47a2-9a51-6d157607730c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1453 microversion: 2.1 time: 0.160759 Aug 17 11:37:37.013371 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 587/1162] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:37:36 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:37:38.940801 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b2248f-a334-4863-99c7-efb97e83d5ba", "tag": "65ef96ca-0c10-4f62-83ef-7fac5c43a6ad"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:37:38.951020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:37:38.951497 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:37:38.951926 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:37:38.963346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] Creating event network-changed:65ef96ca-0c10-4f62-83ef-7fac5c43a6ad for instance 53b2248f-a334-4863-99c7-efb97e83d5ba on hv-cinder-85345 Aug 17 11:37:38.969978 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-c8d1cbe6-d869-4f46-8ca7-763e5c444a0f req-d4e4065d-d98f-4b7b-8c07-4b6f4088f9c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032804 Aug 17 11:37:38.970753 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 576/1163] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:38:48.704026 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=19 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:38:48.705244 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=53 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:38:48.712363 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:48.713170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:48.722715 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:48.723191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:48.723613 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:48.724288 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:48.724729 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:48.725138 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:48.748129 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-8076026d-852c-4205-9545-cf1cf554a668 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/ips" status: 200 len: 151 microversion: 2.1 time: 0.047464 Aug 17 11:38:48.748673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 588/1164] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 11:38:48 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:38:50.111654 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=13 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:38:50.112405 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=33 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:38:50.117254 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189ae1f3-5c07-493f-b2b7-7a6d770541e6"}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:38:50.119682 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:50.126763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:50.127245 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:50.127678 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:50.128374 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:50.128810 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:50.129236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:50.406111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b2cc06bd-319d-4f1b-90fe-65d87a6a3e35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "POST /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296546 Aug 17 11:38:50.406736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 577/1165] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 11:38:50 2022] POST /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:38:58.136276 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:58.136890 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:58.143742 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:58.144222 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:58.144660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:58.145358 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:58.145850 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:58.146267 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:58.230319 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.objects.instance [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lazy-loading 'services' on Instance uuid c4b352c5-b940-4bfa-a497-ea918fa806db {{(pid=120583) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:38:58.309098 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d1ca3b13-ec62-4064-91a7-49a636b4fcbd tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments/189ae1f3-5c07-493f-b2b7-7a6d770541e6" status: 202 len: 0 microversion: 2.1 time: 0.176960 Aug 17 11:38:58.309846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 589/1166] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 11:38:58 2022] DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments/189ae1f3-5c07-493f-b2b7-7a6d770541e6 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:38:58.320080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:58.322791 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:58.329386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:58.330005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:58.330445 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:58.331176 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:58.331631 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:58.332062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:58.363573 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9e5d2585-aa06-4d75-befa-abfd18f7131d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048635 Aug 17 11:38:58.364140 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 578/1167] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:38:58 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:38:59.379060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:59.381643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:59.389048 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.389617 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.390097 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:59.390853 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.391352 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.391817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:59.422024 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-98e9f186-ec70-4924-a886-d21ada05ac01 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048605 Aug 17 11:38:59.422593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 590/1168] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 11:38:59 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 11:38:59.487156 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:59.487716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:59.494587 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.495081 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.495524 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:59.496229 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.496693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.497119 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:59.522282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Going to try to terminate instance {{(pid=120584) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:38:59.605998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2ff86807-14b3-4fcc-8c2a-63fe366c0397 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 204 len: 0 microversion: 2.1 time: 0.122197 Aug 17 11:38:59.606806 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 579/1169] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:38:59 2022] DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:38:59.616374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:38:59.616984 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:38:59.623344 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.623817 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.624253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:38:59.624940 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:38:59.625391 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:38:59.625863 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:00.019146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:00.029600 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ba557438-06d4-488f-83f5-387587290991 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1683 microversion: 2.1 time: 0.417199 Aug 17 11:39:00.030206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 591/1170] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:38:59 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1683 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:01.063586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:01.064745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:01.075823 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:01.076294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:01.076721 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:01.077408 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:01.077948 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:01.078386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:01.219856 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:01.227771 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6a67a3b5-e5c9-4902-beac-959104fcea6d tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1683 microversion: 2.1 time: 0.171318 Aug 17 11:39:01.228352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 580/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:01 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:02.248659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:02.249278 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:02.255499 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:02.256072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:02.256507 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:02.257236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:02.257719 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:02.258167 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:02.329477 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9930ab5b9ede4451b681ef1ecec0605f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cb22f85a04a4b9f56e7b48c7b40c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:02.337728 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c8caf3c6-c993-4b38-b1e6-c8b1c6421d6f tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 200 len: 1615 microversion: 2.1 time: 0.093264 Aug 17 11:39:02.338659 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 592/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:02 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:02.577993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b352c5-b940-4bfa-a497-ea918fa806db", "name": "network-vif-deleted", "tag": "4e6f2c18-5523-41cf-ab32-b20ae8258d85"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:39:02.588878 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:02.589368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:02.590058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:02.603228 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] Creating event network-vif-deleted:4e6f2c18-5523-41cf-ab32-b20ae8258d85 for instance c4b352c5-b940-4bfa-a497-ea918fa806db on hv-cinder-85345 Aug 17 11:39:02.608564 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-9010b69e-25fb-4b95-a92f-51114e06bd1e req-83036b8c-4f4f-4eee-a45e-3c488bad1d79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106759 Aug 17 11:39:02.609208 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 581/1173] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:39:03.358793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:03.360339 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:03.368296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:03.368610 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:03.369033 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:03.369777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:03.370219 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:03.370633 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:03.384586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db HTTP/1.1 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:03.386310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:03.388013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'c4b352c5-b940-4bfa-a497-ea918fa806db'} Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:03.388861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:03.390596 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:03.392010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:03.392010 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-24f3a952-3d12-4016-8e58-a8460a7cbea0 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 404 len: 111 microversion: 2.1 time: 0.033084 Aug 17 11:39:03.392340 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 593/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:03 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:03.398406 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b9c1117b-d2f8-419d-9a21-569cc0666d30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '.version_select at 0x7f904423eb80>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:03.420453 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b9c1117b-d2f8-419d-9a21-569cc0666d30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800998990" status: 202 len: 0 microversion: 2.1 time: 0.026279 Aug 17 11:39:03.421060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 582/1175] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 11:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800998990 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:39:05.198629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:05.199144 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:05.206082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:05.206553 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:05.206975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:05.207661 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:05.208100 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:05.208513 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:05.222090 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db HTTP/1.1 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:05.223641 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.225450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'c4b352c5-b940-4bfa-a497-ea918fa806db'} Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:05.226612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.228297 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.229960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:05.229960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-db3bb2c8-b027-432d-b438-cd39c0fe7b30 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 404 len: 111 microversion: 2.1 time: 0.030635 Aug 17 11:39:05.229960 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 594/1176] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:39:05 2022] DELETE /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:05.233548 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:05.234315 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: c4b352c5-b940-4bfa-a497-ea918fa806db] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:05.243802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:05.244284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:05.244718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:05.245409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:05.245888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:05.246313 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:05.259480 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db HTTP/1.1 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:39:05.261083 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.262900 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'c4b352c5-b940-4bfa-a497-ea918fa806db'} Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:05.264064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. Aug 17 11:39:05.265787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:05.267201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance c4b352c5-b940-4bfa-a497-ea918fa806db could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:05.267201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-9a895ba5-4732-4d18-a510-83825748e5b9 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db" status: 404 len: 111 microversion: 2.1 time: 0.032835 Aug 17 11:39:05.267201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 583/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:05 2022] GET /compute/v2.1/servers/c4b352c5-b940-4bfa-a497-ea918fa806db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:06.433520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:06.434028 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:06.440872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.441356 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.441826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.442558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.443013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.443436 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.457621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d HTTP/1.1 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:06.459202 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.460799 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'daa3c246-901c-4d9c-b49e-0996f07c5f3d'} Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:06.461988 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.463569 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.465827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:06.465827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-eaeb5280-3f31-4cc1-8ac8-ef1694133a20 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 404 len: 111 microversion: 2.1 time: 0.031122 Aug 17 11:39:06.465827 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 595/1178] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:39:06 2022] DELETE /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:06.469305 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:06.470026 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: daa3c246-901c-4d9c-b49e-0996f07c5f3d] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:06.476997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.477500 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.477941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.478651 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.479103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.479521 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.492984 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d HTTP/1.1 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:39:06.494565 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.496224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'daa3c246-901c-4d9c-b49e-0996f07c5f3d'} Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:06.497384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. Aug 17 11:39:06.499106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.500671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance daa3c246-901c-4d9c-b49e-0996f07c5f3d could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:06.500671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-fa466ca1-7850-44cb-ac3c-9ec9586fdcbe tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d" status: 404 len: 111 microversion: 2.1 time: 0.030607 Aug 17 11:39:06.500671 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 584/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:06 2022] GET /compute/v2.1/servers/daa3c246-901c-4d9c-b49e-0996f07c5f3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 11:39:06.505092 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:06.505632 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:06.512133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.512614 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.513055 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.513781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.514236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.514658 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.528981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 HTTP/1.1 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:06.530585 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.532380 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': 'bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6'} Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:06.533364 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.535016 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.536692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:06.536692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-295f8b3f-2f0a-4a6f-bb39-b8950f84106a tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 404 len: 111 microversion: 2.1 time: 0.031039 Aug 17 11:39:06.536692 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 596/1180] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:39:06 2022] DELETE /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:06.540329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:06.540955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:06.547030 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.547562 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.547979 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.548679 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:06.549132 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:06.549582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:06.563110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 HTTP/1.1 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:39:06.564734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.566559 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6'} Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:06.567536 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. Aug 17 11:39:06.569508 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:06.573601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:06.573601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-938db0f3-f817-449b-b019-c6b5be2f5864 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6" status: 404 len: 111 microversion: 2.1 time: 0.029644 Aug 17 11:39:06.573601 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 585/1181] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:06 2022] GET /compute/v2.1/servers/bb4d7f88-4435-4ed1-8a1f-7f8d4d85d7c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:07.724969 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:07.725560 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:07.732689 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:07.733210 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:07.733684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:07.734397 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:07.734846 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:07.735262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:07.750725 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 HTTP/1.1 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:07.752411 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.754289 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '94c9ca99-0ecf-4de9-a6be-d1018f6d78d7'} Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:07.755471 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.757221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.758851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:07.758851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6bc67cad-e149-4f68-9696-9dfb822a9c35 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 404 len: 111 microversion: 2.1 time: 0.033300 Aug 17 11:39:07.758851 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 597/1182] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:39:07 2022] DELETE /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:07.762962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:07.763612 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] [instance: 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:07.770997 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:07.771481 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:07.771919 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:07.772627 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:07.773082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:07.773533 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:07.787397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] HTTP exception thrown: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Request method failure captured: Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 HTTP/1.1 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NG1YEbsqqdj9fyvi2utUeqtGA-7r1dH5d7lYvgNFgbW4bP7dXlE1JClPIxXHl_96Y4-QqIrmHBUDmsV3KI4KjekOj4j3iRfzWldV-4NxYWHrhE0iWQOBKn9I-5iN-mAkI_Pbb0rXl37CMzbYMHc9FdpxvFtQL7lt17_lDVhqwmCsT8 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:39:07.788909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/044cb22f85a04a4b9f56e7b48c7b40c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_044cb22f85a04a4b9f56e7b48c7b40c7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 044cb22f85a04a4b9f56e7b48c7b40c7 Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784190762 Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: 9930ab5b9ede4451b681ef1ecec0605f Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-AttachVolumeNegativeTest-784190762-project Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.790528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '94c9ca99-0ecf-4de9-a6be-d1018f6d78d7'} Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:07.791380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. Aug 17 11:39:07.792680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:39:07.794080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] Returning 404 to user: Instance 94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:07.794080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-5e698d30-c0a8-453c-b6fc-01eddbe44021 tempest-AttachVolumeNegativeTest-784190762 tempest-AttachVolumeNegativeTest-784190762-project] 10.222.0.15 "GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7" status: 404 len: 111 microversion: 2.1 time: 0.031731 Aug 17 11:39:07.794080 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 586/1183] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:07 2022] GET /compute/v2.1/servers/94c9ca99-0ecf-4de9-a6be-d1018f6d78d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:53.375283 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:53.376128 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:53.378914 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=20 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:39:53.379568 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:39:53.385466 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:53.385944 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:53.386374 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:53.387124 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:53.387539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:53.387949 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:53.414262 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:39:53.497860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-2ddcc630-2389-4b03-8cce-bf012f2ff62e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 204 len: 0 microversion: 2.1 time: 0.128697 Aug 17 11:39:53.498733 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 598/1184] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:39:53 2022] DELETE /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 11:39:53.507683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:53.508294 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:53.510552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:39:53.511197 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:39:53.516588 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:53.517065 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:53.517578 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:53.518266 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:53.518727 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:53.519126 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:53.654918 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:53.663146 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-16f5c394-7775-48d5-a89d-d50fe15b9305 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1578 microversion: 2.1 time: 0.159490 Aug 17 11:39:53.663698 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 587/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:53 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:54.684861 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:54.685582 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:54.692435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:54.692919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:54.693354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:54.694450 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:54.694905 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:54.695329 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:54.833533 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:54.841206 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-4bcfae11-64a3-4257-baef-6c8b2d60e5a3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1578 microversion: 2.1 time: 0.160751 Aug 17 11:39:54.841792 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 599/1186] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:54 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:55.862574 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:55.863862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:55.870832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:55.871319 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:55.871799 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:55.872513 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:55.872952 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:55.873381 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:56.084580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:56.093106 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-07333a32-87c4-4e28-892a-c938bb2aa3e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1578 microversion: 2.1 time: 0.234515 Aug 17 11:39:56.093941 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 588/1187] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:55 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:56.332666 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b2248f-a334-4863-99c7-efb97e83d5ba", "name": "network-vif-deleted", "tag": "65ef96ca-0c10-4f62-83ef-7fac5c43a6ad"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:39:56.347647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:56.348382 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:56.348990 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:56.372209 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] Creating event network-vif-deleted:65ef96ca-0c10-4f62-83ef-7fac5c43a6ad for instance 53b2248f-a334-4863-99c7-efb97e83d5ba on hv-cinder-85345 Aug 17 11:39:56.378317 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-f99530e2-2020-4e7f-8025-eb0b627e3cb6 req-cbbf8466-e122-4363-8e4a-ccb45a746a92 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054963 Aug 17 11:39:56.379534 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 600/1188] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:39:57.122320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:57.123734 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:57.130530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:57.131280 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:57.131876 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:57.132772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:57.133619 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:57.134204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:57.176898 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:57.177832 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:57.178476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:57.179084 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.objects.instance [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lazy-loading 'fault' on Instance uuid 53b2248f-a334-4863-99c7-efb97e83d5ba {{(pid=120584) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 11:39:57.231660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:57.239414 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2d8b9c1f-f56c-45ed-bf76-5d3a8fc62365 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 200 len: 1184 microversion: 2.1 time: 0.121124 Aug 17 11:39:57.239994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 589/1189] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:57 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 1184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:39:58.263309 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:58.264156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:58.270699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:58.271208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:58.271643 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:58.272342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:58.272795 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:58.273281 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:58.287000 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] HTTP exception thrown: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Request method failure captured: Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba HTTP/1.1 Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NLUKHYlNnS8FTCCZgTfnI2Xdx7qLpeII_qQPblHg5qFc6F_Y3ofB-nmPghThXYMDqxrd8e91lti1S65cDIZyU_TL9sKgPb-d9Cf4GQ5uZ1b7NoEpK83f-EIrB_FEkWNBrKasKfOHl0QO4D9nGNwet26qKm10qqZ5p43PcY5vsCuduw Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:39:58.288699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/17804d0c9bf140938c3f549444de03be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_17804d0c9bf140938c3f549444de03be", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-TestVolumeBootPattern-161977318 Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e389e4bc234f4d5eb69b70eb7ffb6608 Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:39:58.290506 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '53b2248f-a334-4863-99c7-efb97e83d5ba'} Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:39:58.291738 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:39:58.293745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:39:58.295369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Returning 404 to user: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:39:58.295369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7bf99914-3af8-40cb-ba31-c8271e7add16 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 404 len: 111 microversion: 2.1 time: 0.031501 Aug 17 11:39:58.295369 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 601/1190] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:58 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:39:58.386441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2146010966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1696160650", "security_groups": [{"name": "tempest-secgroup-smoke-470505449"}], "block_device_mapping_v2": [{"uuid": "f99af1de-77c0-4f47-845c-eb317b77c1f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93282624-776f-4cbf-a67b-19d0ed326f7b"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:39:58.505290 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] validate_networks() for [('93282624-776f-4cbf-a67b-19d0ed326f7b', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:39:58.993838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:39:58.994241 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:39:58.994709 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:39:58.995111 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:39:58.995517 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:39:59.004438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:59.005154 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:59.005962 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:59.007060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:39:59.007846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:39:59.008286 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:39:59.026444 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:39:59.032201 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for user e389e4bc234f4d5eb69b70eb7ffb6608 and project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:39:59.099864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:39:59.102103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f99af1de-77c0-4f47-845c-eb317b77c1f6',volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:39:59.252284 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-6b9b92d1-cbc9-401c-bb7b-0cd6a91b8cb8 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.869552 Aug 17 11:39:59.252869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 590/1191] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:39:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:39:59.264558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5711b1bc-821f-4d86-99b9-373a826bf3d3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:39:59.265977 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5711b1bc-821f-4d86-99b9-373a826bf3d3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:39:59.329971 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5711b1bc-821f-4d86-99b9-373a826bf3d3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:39:59.337731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5711b1bc-821f-4d86-99b9-373a826bf3d3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1095 microversion: 2.1 time: 0.077274 Aug 17 11:39:59.338683 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 602/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:39:59 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:00.359552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:00.360328 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:00.366787 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:00.367277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:00.367802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:00.368477 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:00.369217 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:00.369746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:00.454972 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:00.462495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-cd26fb23-f7bd-47b1-a92c-6032c7d29d74 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1211 microversion: 2.1 time: 0.107732 Aug 17 11:40:00.463057 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 591/1193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:00 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:01.483933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:01.484527 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:01.492305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:01.492872 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:01.493362 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:01.494146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:01.494660 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:01.495300 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:01.960043 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:01.969156 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-18e633cb-50bd-4bad-981b-e924ece3d0ac tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.489010 Aug 17 11:40:01.970552 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 603/1194] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:01 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:02.018247 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ec4a99-0f38-4972-aaa6-10ffa345ffd0", "tag": "4d1955f4-b35f-4c5e-95e0-20838da4962b"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:40:02.031318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:02.031874 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:02.032409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:02.045064 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] Creating event network-changed:4d1955f4-b35f-4c5e-95e0-20838da4962b for instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 on hv-cinder-85345 Aug 17 11:40:02.050912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-fb57c3a7-4dd4-472b-a364-5092761e1eae req-e7515bd4-833d-4588-b762-42c217c7abd9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036738 Aug 17 11:40:02.052333 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 592/1195] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:40:02.990447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:02.991135 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:02.997347 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:02.997777 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:02.998191 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:02.998871 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:02.999318 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:02.999732 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:03.150979 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:03.159412 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-267e0739-6c0c-4cac-a6d1-69a362dc4eb2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.172833 Aug 17 11:40:03.160071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 604/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:02 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:04.181676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:04.182510 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:04.188749 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:04.189260 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:04.189724 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:04.190411 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:04.190864 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:04.191285 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:04.341741 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:04.349763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-ed955a15-c493-43af-b17d-6f9d35ab3276 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.173131 Aug 17 11:40:04.350803 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 593/1197] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:04 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:05.372035 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:05.372722 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:05.379814 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:05.380305 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:05.380741 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:05.381461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:05.381935 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:05.382394 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:05.519667 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:05.527618 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-02b17259-f278-418e-905a-b9e3f2e5ef72 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.159807 Aug 17 11:40:05.528296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 605/1198] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:05 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:06.549004 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:06.549680 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:06.556660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:06.557242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:06.557733 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:06.558420 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:06.558869 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:06.559290 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:06.706921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:06.715121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-56e84dd1-eb76-4db2-bf20-591de155c839 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.169999 Aug 17 11:40:06.715746 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 594/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:06 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:07.744472 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:07.745539 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:07.756505 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:07.757321 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:07.758105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:07.759285 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:07.760056 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:07.760769 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:07.904907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:07.912757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-732d3d9d-6015-443f-8403-2a337968a7b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.174724 Aug 17 11:40:07.913354 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 606/1200] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:07 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:08.933772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:08.934585 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:08.941782 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:08.942338 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:08.942813 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:08.943543 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:08.944019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:08.944768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:09.016336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:40:09.039476 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:40:09.083236 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:09.093253 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-3b1dec37-71dd-4757-8cd3-d9a940a19483 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.163212 Aug 17 11:40:09.094093 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 595/1201] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:08 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:10.119059 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:10.119698 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:10.122154 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:40:10.128105 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:10.128592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:10.129034 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:10.129797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:10.130253 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:10.130707 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:10.274743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:10.282996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3789800b-562d-444b-bad9-5de754d934b1 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.167932 Aug 17 11:40:10.283565 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 607/1202] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:10 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:11.303755 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:11.304580 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:11.311528 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:11.312028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:11.312437 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:11.313183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:11.313693 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:11.314121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:11.461329 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:11.469676 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a292230f-7778-46ed-bc5f-ba60e127e792 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.169947 Aug 17 11:40:11.470258 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 596/1203] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:11 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:12.490696 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:12.491349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:12.498272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:12.498746 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:12.499171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:12.499854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:12.500296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:12.500712 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:12.644302 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:12.652060 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-5fae0c53-b1a4-4abd-859f-17357daa1dd3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.165307 Aug 17 11:40:12.652622 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 608/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:12 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:13.552378 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ec4a99-0f38-4972-aaa6-10ffa345ffd0", "name": "network-vif-plugged", "status": "completed", "tag": "4d1955f4-b35f-4c5e-95e0-20838da4962b"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:40:13.562561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:13.563033 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:13.563461 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:13.575163 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] Creating event network-vif-plugged:4d1955f4-b35f-4c5e-95e0-20838da4962b for instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 on hv-cinder-85345 Aug 17 11:40:13.580397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-966461b1-dcb3-4634-92d4-e61f0db34755 req-55d82b61-9242-4ebb-ae6c-0e4de67717e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187232 Aug 17 11:40:13.581054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 597/1205] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:40:13.673259 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:13.673912 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:13.680708 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:13.681193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:13.681673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:13.682366 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:13.682823 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:13.683254 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:13.857187 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:13.865008 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-d9146aa0-5c3a-4887-a4d8-0e9aee0f2fbd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.195696 Aug 17 11:40:13.865647 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 609/1206] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:13 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:14.888097 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:14.888802 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:14.895589 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:14.896082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:14.896519 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:14.897224 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:14.897701 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:14.898219 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:15.034306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:15.041725 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-2d0ee056-e3d7-46a1-80a8-6b51d7b2df0e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1266 microversion: 2.1 time: 0.159389 Aug 17 11:40:15.042523 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 598/1207] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:14 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:16.066611 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:16.067455 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:16.078744 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:16.079531 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:16.080233 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:16.082040 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:16.082207 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:16.082816 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:16.222518 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:16.234345 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-863ab8b2-8072-4287-bfdb-5aa99eb50cc3 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1453 microversion: 2.1 time: 0.174225 Aug 17 11:40:16.235102 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 610/1208] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:16 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:16.262298 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:40:16.262892 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:40:16.272868 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:16.273539 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:16.274130 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:16.275141 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:16.275790 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:16.276379 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:16.410544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:40:16.418402 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-1581279f-8f6f-4203-9640-13f899eb53ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1453 microversion: 2.1 time: 0.162522 Aug 17 11:40:16.418966 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 599/1209] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:40:16 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:40:18.054260 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ec4a99-0f38-4972-aaa6-10ffa345ffd0", "tag": "4d1955f4-b35f-4c5e-95e0-20838da4962b"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:40:18.064015 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:40:18.064488 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:40:18.064917 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:40:18.076829 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] Creating event network-changed:4d1955f4-b35f-4c5e-95e0-20838da4962b for instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 on hv-cinder-85345 Aug 17 11:40:18.082169 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-8dca3729-043f-481c-9950-84e00a022d4b req-a396bb32-5a4c-4bb3-977c-df6d21a411f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Aug 17 11:40:18.082882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 611/1210] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:41:28.469838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:41:28.471246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:41:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:42:31.110628 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:31.111380 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=68 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:31.115718 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1606880747", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1696160650", "security_groups": [{"name": "tempest-secgroup-smoke-470505449"}], "block_device_mapping_v2": [{"uuid": "b7e7857f-cdb0-4e97-a9b4-e8111ba997a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "93282624-776f-4cbf-a67b-19d0ed326f7b"}]}} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:42:31.364936 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.network.neutron [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] validate_networks() for [('93282624-776f-4cbf-a67b-19d0ed326f7b', None, None, None, None, None)] {{(pid=120584) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 11:42:31.777110 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 11:42:31.777745 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image limits 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 11:42:31.778432 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Flavor pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 11:42:31.778994 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Image pref 0:0:0 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 11:42:31.779529 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.virt.hardware [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120584) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 11:42:31.792077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:31.792816 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:31.793261 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:31.794021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:31.794498 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:31.794912 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:31.812059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 11:42:31.816334 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.quota [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Getting quotas for user e389e4bc234f4d5eb69b70eb7ffb6608 and project 17804d0c9bf140938c3f549444de03be. Resources: {'cores', 'instances', 'ram'} {{(pid=120584) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 11:42:31.874648 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Going to run 1 instances... {{(pid=120584) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 11:42:31.876750 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7e7857f-cdb0-4e97-a9b4-e8111ba997a8',volume_size=None,volume_type=None)] {{(pid=120584) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 11:42:32.019716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [19ffc95f-6fb9-4963-aa76-09f611b4a5e8] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 11:42:33.033397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [19ffc95f-6fb9-4963-aa76-09f611b4a5e8] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 49644. Aug 17 11:42:33.040373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-bd46f6ce-e09f-44ef-bd58-75f1edf908b2 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.931220 Aug 17 11:42:33.041453 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 600/1211] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 11:42:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 11:42:33.052153 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR oslo.messaging._drivers.impl_rabbit [-] [88291f51-5de4-49ec-9f88-f01aedcb7536] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 11:42:33.052918 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:33.053682 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:33.060887 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6f550362-6a72-4f88-8a48-f5c2a3992851 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:33.061650 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6f550362-6a72-4f88-8a48-f5c2a3992851 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:33.230897 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-6f550362-6a72-4f88-8a48-f5c2a3992851 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:33.237907 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6f550362-6a72-4f88-8a48-f5c2a3992851 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1095 microversion: 2.1 time: 0.188046 Aug 17 11:42:33.238476 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 612/1212] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:33 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1095 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:34.258969 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:34.259518 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:34.267311 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:34.268048 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:34.268213 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:34.268909 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:34.269352 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:34.269788 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:34.343753 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:34.351636 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-0027f89a-39b8-426f-9c44-a2346275808c tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1211 microversion: 2.1 time: 0.096973 Aug 17 11:42:34.352267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 601/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:34 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:35.291193 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:42:35.291812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:42:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:42:35.373794 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:35.374447 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:35.384071 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:35.384545 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:35.384981 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:35.385716 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:35.386170 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:35.386593 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:35.392509 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] [88291f51-5de4-49ec-9f88-f01aedcb7536] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 49672. Aug 17 11:42:35.604629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:35.612812 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-36a935d9-c4d8-4ea7-8e78-15fc671b85d0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.243690 Aug 17 11:42:35.613414 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 613/1214] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:35 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:35.697440 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd00f641-e648-4210-9d50-04beb6305bec", "tag": "622746b7-70e8-4c78-8e1d-1736a135dd93"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:42:35.708561 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:35.709134 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:35.709652 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:35.720949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] Creating event network-changed:622746b7-70e8-4c78-8e1d-1736a135dd93 for instance fd00f641-e648-4210-9d50-04beb6305bec on hv-cinder-85345 Aug 17 11:42:35.726077 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-633a3729-7e5c-420d-8c16-95c57aee4a03 req-8c9e0af1-182d-4d70-8439-b08e6217f88f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032920 Aug 17 11:42:35.726663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 602/1215] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:42:36.639203 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:36.639793 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:36.646735 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:36.647208 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:36.647636 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:36.648326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:36.648766 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:36.649181 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:36.786945 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:36.797104 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-3c015c7e-4f60-4f2d-a990-e871cee2c6af tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.164826 Aug 17 11:42:36.797703 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 614/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:36 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:42:37.824036 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:37.825039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:37.835402 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:37.836234 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:37.836940 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:37.838142 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:37.838888 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:37.839582 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:37.976658 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:37.987657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-b2ef02b7-8126-4980-b017-0a0469462b3d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.171721 Aug 17 11:42:37.988441 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 603/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:37 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:39.013236 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:39.014230 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:39.022951 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:39.023597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:39.024143 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:39.025023 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:39.025639 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:39.026171 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:39.164882 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:39.174310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7dccc6cd-56cd-499c-ad5d-c8666b7bfd6b tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.167664 Aug 17 11:42:39.174880 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 615/1218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:39 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:40.199896 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:40.200777 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:40.211268 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:40.212059 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:40.212773 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:40.214056 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:40.214808 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:40.215506 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:40.349262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:40.361256 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-69cf8f71-dcb0-4e59-b0eb-5632abfcaee4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.168270 Aug 17 11:42:40.362061 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 604/1219] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:40 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:41.390089 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:41.390805 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:41.398765 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:41.399326 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:41.399828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:41.400629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:41.401151 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:41.401677 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:41.542826 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:41.554192 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-222773f1-9040-40d6-aa63-967c36d36bf4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.169996 Aug 17 11:42:41.554876 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 616/1220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:41 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:42.579604 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:42.580657 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:42.584526 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=2 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:42.585644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell0:SELECT=6 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:42.594190 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:42.594668 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:42.595088 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:42.595772 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:42.596220 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:42.596632 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:42.744058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:42.752216 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-01480e5d-3f1b-4366-93a4-059f8a2373fd tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.179358 Aug 17 11:42:42.752760 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 605/1221] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:42 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:43.776954 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:43.777940 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:43.781673 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell0:SELECT=2 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:42:43.787116 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:43.787592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:43.788017 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:43.788699 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:43.789149 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:43.789580 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:43.947001 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:43.956963 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-7472935a-3c6b-42f5-9148-67d9a1549d90 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.186289 Aug 17 11:42:43.957781 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 617/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:43 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:44.980318 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:44.980946 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:44.987544 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:44.988021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:44.988446 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:44.989122 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:44.989600 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:44.990008 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:45.212237 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:45.220368 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-97b425b8-2235-4f79-b95b-b64397d72176 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.243931 Aug 17 11:42:45.220960 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 606/1223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:44 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:46.240978 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:46.241654 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:46.248151 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:46.248642 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:46.249072 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:46.249796 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:46.250250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:46.250674 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:46.404461 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:46.417686 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-c561e9fa-e946-45a9-b7c2-a9ec1292da4d tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.180283 Aug 17 11:42:46.418586 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 618/1224] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:46 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:47.442833 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:47.443496 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:47.451231 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:47.451763 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:47.452242 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:47.453001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:47.453538 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:47.454005 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:47.594459 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:47.602456 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-c5d67720-195a-483e-b910-c670e3d241ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.164681 Aug 17 11:42:47.603239 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 607/1225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:47 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:48.232293 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00f641-e648-4210-9d50-04beb6305bec", "name": "network-vif-plugged", "status": "completed", "tag": "622746b7-70e8-4c78-8e1d-1736a135dd93"}]} {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:42:48.242292 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:48.242767 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:48.243195 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:48.255101 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.compute.server_external_events [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] Creating event network-vif-plugged:622746b7-70e8-4c78-8e1d-1736a135dd93 for instance fd00f641-e648-4210-9d50-04beb6305bec on hv-cinder-85345 Aug 17 11:42:48.260228 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [req-3d9b5307-926e-4dfb-a942-b465af583b47 req-5f67a7b6-e1c5-4fae-b33a-4bcca7431039 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Aug 17 11:42:48.260815 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 619/1226] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:42:48.623415 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:48.624058 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:48.630921 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:48.631469 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:48.631854 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:48.632546 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:48.632998 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:48.633399 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:48.790019 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:48.800530 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-adf9a124-b797-4709-bb39-ba799b2554e4 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.181039 Aug 17 11:42:48.801165 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 608/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:48 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:49.823146 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:49.823743 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:49.830250 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:49.830731 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:49.831160 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:49.831839 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:49.832296 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:49.832713 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:49.963697 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:49.971706 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-80dbb33c-6c77-48c6-b654-b0d6dccf860e tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1266 microversion: 2.1 time: 0.153809 Aug 17 11:42:49.972272 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 620/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:49 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:51.003267 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:51.004281 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:51.015312 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:51.016020 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:51.016783 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:51.017970 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:51.018728 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:51.019346 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:51.169252 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:51.181204 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-51739b77-5eea-4a5e-b3c5-0976b53344ca tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1453 microversion: 2.1 time: 0.184390 Aug 17 11:42:51.182184 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 609/1229] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:50 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:51.202125 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:42:51.202762 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:42:51.209557 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:51.210037 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:51.210464 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:51.211150 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:51.211597 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:51.212019 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:51.348854 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:42:51.360933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-313d0c25-9e10-498f-9f66-6e8d28ad6961 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1453 microversion: 2.1 time: 0.162374 Aug 17 11:42:51.361778 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 621/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:42:51 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:42:53.150980 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd00f641-e648-4210-9d50-04beb6305bec", "tag": "622746b7-70e8-4c78-8e1d-1736a135dd93"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:42:53.160386 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:42:53.160862 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:42:53.161282 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:42:53.172332 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] Creating event network-changed:622746b7-70e8-4c78-8e1d-1736a135dd93 for instance fd00f641-e648-4210-9d50-04beb6305bec on hv-cinder-85345 Aug 17 11:42:53.177373 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-25e76ee2-1ec1-4119-a911-c27c6a810aa4 req-fb10f315-7619-4006-ba1b-1a7547956932 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089388 Aug 17 11:42:53.177993 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 610/1231] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:43:06.263496 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:43:06.264592 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:43:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:44:41.293928 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_api:SELECT=22 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:44:41.294745 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG dbcounter [-] [120583] Writing DB stats nova_cell1:SELECT=50 {{(pid=120583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:44:41.297007 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:44:41.297903 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG dbcounter [-] [120584] Writing DB stats nova_cell1:SELECT=54 {{(pid=120584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:44:41.299788 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:41.300349 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:41.303021 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd00f641-e648-4210-9d50-04beb6305bec", "tag": "622746b7-70e8-4c78-8e1d-1736a135dd93"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:44:41.308396 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:41.308889 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:41.309367 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:41.310112 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:41.310629 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:41.311082 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:41.314209 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:41.314681 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:41.315103 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:41.326937 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] Creating event network-changed:622746b7-70e8-4c78-8e1d-1736a135dd93 for instance fd00f641-e648-4210-9d50-04beb6305bec on hv-cinder-85345 Aug 17 11:44:41.332221 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-932449de-2d01-4647-b563-599c7042b318 req-7b34f278-2e02-45a3-8b85-f927dd789dd4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037197 Aug 17 11:44:41.333014 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 611/1232] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:44:41.339327 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:44:41.427413 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9e784029-b317-4ee6-85ed-913436d6012f tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 204 len: 0 microversion: 2.1 time: 0.134961 Aug 17 11:44:41.428291 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 622/1233] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:44:41 2022] DELETE /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:44:41.437113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:41.438127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:41.444804 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:41.445277 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:41.445736 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:41.446417 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:41.446860 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:41.447271 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:41.579793 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:41.587409 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-750e21ff-f197-4297-bef2-9770c134e353 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1578 microversion: 2.1 time: 0.154691 Aug 17 11:44:41.588001 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 612/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:41 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 11:44:42.609122 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:42.609964 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:42.616737 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:42.617221 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:42.617694 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:42.618392 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:42.618840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:42.619257 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:42.810452 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:42.818626 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-b5634643-aba1-4591-84f9-df89386961fc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1578 microversion: 2.1 time: 0.213941 Aug 17 11:44:42.819522 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 623/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:42 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:44:43.735827 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00f641-e648-4210-9d50-04beb6305bec", "name": "network-vif-deleted", "tag": "622746b7-70e8-4c78-8e1d-1736a135dd93"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:44:43.745870 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:43.746337 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:43.746955 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:43.758118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] Creating event network-vif-deleted:622746b7-70e8-4c78-8e1d-1736a135dd93 for instance fd00f641-e648-4210-9d50-04beb6305bec on hv-cinder-85345 Aug 17 11:44:43.763060 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-69f9523c-c1a8-4f14-9ac0-2bb9df720730 req-0e361335-e104-4605-8bfb-33195b484b44 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Aug 17 11:44:43.763675 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 613/1236] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:44:43.840646 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:43.841342 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:43.848277 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:43.848763 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:43.849199 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:43.849933 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:43.850388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:43.850811 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:43.916757 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:43.924672 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-70fcff47-1fc6-49f3-96e1-737f36425524 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 200 len: 1226 microversion: 2.1 time: 0.088251 Aug 17 11:44:43.925263 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 624/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:43 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:44:44.950944 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:44.952039 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: fd00f641-e648-4210-9d50-04beb6305bec] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:44.962024 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:44.962757 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:44.963431 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:44.964479 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:44.965168 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:44.965819 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:44.979121 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] HTTP exception thrown: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Request method failure captured: Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec HTTP/1.1 Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NLUKHYlNnS8FTCCZgTfnI2Xdx7qLpeII_qQPblHg5qFc6F_Y3ofB-nmPghThXYMDqxrd8e91lti1S65cDIZyU_TL9sKgPb-d9Cf4GQ5uZ1b7NoEpK83f-EIrB_FEkWNBrKasKfOHl0QO4D9nGNwet26qKm10qqZ5p43PcY5vsCuduw Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:44:44.980716 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/17804d0c9bf140938c3f549444de03be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_17804d0c9bf140938c3f549444de03be", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: e389e4bc234f4d5eb69b70eb7ffb6608 Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. Aug 17 11:44:44.982586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'fd00f641-e648-4210-9d50-04beb6305bec'} Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:44:44.983611 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. Aug 17 11:44:44.985387 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:44.986902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Returning 404 to user: Instance fd00f641-e648-4210-9d50-04beb6305bec could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:44:44.986902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-a76b6bc8-3324-443b-bd3e-ca7e37c7e9b0 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec" status: 404 len: 111 microversion: 2.1 time: 0.038961 Aug 17 11:44:44.986902 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 614/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:44 2022] GET /compute/v2.1/servers/fd00f641-e648-4210-9d50-04beb6305bec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:44:48.342558 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:48.343113 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:48.344202 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ec4a99-0f38-4972-aaa6-10ffa345ffd0", "tag": "4d1955f4-b35f-4c5e-95e0-20838da4962b"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:44:48.349802 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:48.350688 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:48.351388 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:48.352261 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:48.352956 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:48.353435 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:48.353586 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:48.354062 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:48.354483 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:48.366148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] Creating event network-changed:4d1955f4-b35f-4c5e-95e0-20838da4962b for instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 on hv-cinder-85345 Aug 17 11:44:48.372992 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-12b67205-38e6-4963-8807-27a489f31634 req-4c936d0c-4ed6-482f-81e3-a927a53099ab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031972 Aug 17 11:44:48.374159 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 615/1239] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 11:44:48.379840 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Going to try to terminate instance {{(pid=120583) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 11:44:48.466797 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-9057b041-a2db-41cd-8e67-cf6b4e035086 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 204 len: 0 microversion: 2.1 time: 0.127798 Aug 17 11:44:48.467819 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 625/1240] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:44:48 2022] DELETE /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 11:44:48.477098 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:48.477824 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:48.483023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:44:48.483225 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:44:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 (ip 10.222.0.15) !!! Aug 17 11:44:48.486365 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:48.488028 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:48.488663 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:48.490320 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:48.491192 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:48.491908 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:48.623262 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.policy [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120584) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:48.631118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-7ddd3967-e138-4fee-b806-b4befa3e8fb9 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1577 microversion: 2.1 time: 0.158612 Aug 17 11:44:48.631683 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 616/1241] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:48 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:44:49.653621 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:49.654319 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:49.661389 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:49.661894 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:49.662320 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:49.663013 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:49.663456 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:49.663870 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:49.795559 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:49.803566 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-e2053fa5-76c6-44e3-923d-69d2171e1dfc tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1577 microversion: 2.1 time: 0.154718 Aug 17 11:44:49.804133 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 626/1242] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:49 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:44:50.766751 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ec4a99-0f38-4972-aaa6-10ffa345ffd0", "name": "network-vif-deleted", "tag": "4d1955f4-b35f-4c5e-95e0-20838da4962b"}]} {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 11:44:50.777660 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:50.778148 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:50.778577 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:50.789729 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.compute.server_external_events [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] Creating event network-vif-deleted:4d1955f4-b35f-4c5e-95e0-20838da4962b for instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 on hv-cinder-85345 Aug 17 11:44:50.794768 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [req-cfd3eeb3-bbfd-4ebc-82cb-c23fb97077ea req-91026572-0cc6-4a9a-b348-06b30befd13d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110665 Aug 17 11:44:50.795384 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 617/1243] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 11:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 11:44:50.825147 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:50.826115 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:50.835074 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:50.835546 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:50.835996 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:50.836828 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:50.837785 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:50.837919 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:50.912983 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.policy [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e389e4bc234f4d5eb69b70eb7ffb6608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17804d0c9bf140938c3f549444de03be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120583) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 11:44:50.921286 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-ecc1c1d2-f571-44de-8cae-764a1927b7e5 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 200 len: 1226 microversion: 2.1 time: 0.100187 Aug 17 11:44:50.922196 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 627/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:50 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 11:44:51.948383 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:51.949495 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: c3ec4a99-0f38-4972-aaa6-10ffa345ffd0] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:51.957607 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:51.958118 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:51.958552 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:51.959246 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:51.959698 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:51.960127 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:51.973838 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] HTTP exception thrown: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Request method failure captured: Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 HTTP/1.1 Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NLUKHYlNnS8FTCCZgTfnI2Xdx7qLpeII_qQPblHg5qFc6F_Y3ofB-nmPghThXYMDqxrd8e91lti1S65cDIZyU_TL9sKgPb-d9Cf4GQ5uZ1b7NoEpK83f-EIrB_FEkWNBrKasKfOHl0QO4D9nGNwet26qKm10qqZ5p43PcY5vsCuduw Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:44:51.975487 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/17804d0c9bf140938c3f549444de03be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_17804d0c9bf140938c3f549444de03be", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: e389e4bc234f4d5eb69b70eb7ffb6608 Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. Aug 17 11:44:51.977255 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': 'c3ec4a99-0f38-4972-aaa6-10ffa345ffd0'} Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:44:51.978438 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. Aug 17 11:44:51.980082 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:51.981814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Returning 404 to user: Instance c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:44:51.981814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4c4a0aec-ee33-48e1-b49d-687be29f3740 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0" status: 404 len: 111 microversion: 2.1 time: 0.035467 Aug 17 11:44:51.981814 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 618/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:51 2022] GET /compute/v2.1/servers/c3ec4a99-0f38-4972-aaa6-10ffa345ffd0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:44:52.427164 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:52.427684 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.compute.api [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120583) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:52.434549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:52.435021 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:52.435444 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:52.436225 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:52.436670 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:52.437081 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG oslo_concurrency.lockutils [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:52.450809 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.wsgi [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] HTTP exception thrown: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Request method failure captured: Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: request: DELETE /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba HTTP/1.1 Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept: application/json Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Accept-Encoding: identity Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Connection: close Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Length: 0 Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Content-Type: application/json Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Host: 10.222.0.15 Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Openstack-System-Scope: None Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: User-Agent: python-urllib3/1.26.11 Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Auth-Token: gAAAAABi_NLUKHYlNnS8FTCCZgTfnI2Xdx7qLpeII_qQPblHg5qFc6F_Y3ofB-nmPghThXYMDqxrd8e91lti1S65cDIZyU_TL9sKgPb-d9Cf4GQ5uZ1b7NoEpK83f-EIrB_FEkWNBrKasKfOHl0QO4D9nGNwet26qKm10qqZ5p43PcY5vsCuduw Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Id: None Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Domain-Name: None Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Identity-Status: Confirmed Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Is-Admin-Project: True Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Id: default Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Domain-Name: Default Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Project-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Role: member,reader Aug 17 11:44:52.452460 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Roles: member,reader Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/17804d0c9bf140938c3f549444de03be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_17804d0c9bf140938c3f549444de03be", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-Tenant-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Id: default Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Domain-Name: Default Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Id: e389e4bc234f4d5eb69b70eb7ffb6608 Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: X-User-Name: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: method: > Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: exception: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.454246 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: action_args: {'id': '53b2248f-a334-4863-99c7-efb97e83d5ba'} Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:44:52.455087 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.456484 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.457992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Returning 404 to user: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. {{(pid=120583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:44:52.457992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-6420a18e-2088-4754-8ad3-cc9a8d0a3618 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 404 len: 111 microversion: 2.1 time: 0.030627 Aug 17 11:44:52.457992 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 628/1246] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 11:44:52 2022] DELETE /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:44:52.462644 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '>' {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:52.463253 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.compute.api [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] [instance: 53b2248f-a334-4863-99c7-efb97e83d5ba] Fetching instance by UUID {{(pid=120584) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 11:44:52.469336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:52.469846 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:52.470273 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:52.470949 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Acquiring lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 11:44:52.471389 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 11:44:52.471800 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG oslo_concurrency.lockutils [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Lock "a3887d9d-dee7-43d6-9d53-02c47e9236a8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 11:44:52.484863 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.wsgi [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] HTTP exception thrown: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Request method failure captured: Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: request: GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba HTTP/1.1 Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept: application/json Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Accept-Encoding: identity Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Connection: close Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Length: 0 Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Content-Type: application/json Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Host: 10.222.0.15 Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Openstack-System-Scope: None Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: User-Agent: python-urllib3/1.26.11 Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Auth-Token: gAAAAABi_NLUKHYlNnS8FTCCZgTfnI2Xdx7qLpeII_qQPblHg5qFc6F_Y3ofB-nmPghThXYMDqxrd8e91lti1S65cDIZyU_TL9sKgPb-d9Cf4GQ5uZ1b7NoEpK83f-EIrB_FEkWNBrKasKfOHl0QO4D9nGNwet26qKm10qqZ5p43PcY5vsCuduw Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Id: None Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Domain-Name: None Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Identity-Status: Confirmed Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Is-Admin-Project: True Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Id: default Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Domain-Name: Default Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Project-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Role: member,reader Aug 17 11:44:52.486397 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Roles: member,reader Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/17804d0c9bf140938c3f549444de03be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/17804d0c9bf140938c3f549444de03be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_17804d0c9bf140938c3f549444de03be", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}] Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Id: 17804d0c9bf140938c3f549444de03be Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-Tenant-Name: tempest-TestVolumeBootPattern-161977318 Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Id: default Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Domain-Name: Default Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Id: e389e4bc234f4d5eb69b70eb7ffb6608 Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: X-User-Name: tempest-TestVolumeBootPattern-161977318-project Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: method: > Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: exception: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.488113 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: action_args: {'id': '53b2248f-a334-4863-99c7-efb97e83d5ba'} Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: {{(pid=120584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 11:44:52.488971 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. Aug 17 11:44:52.490336 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: ERROR nova.api.openstack.wsgi Aug 17 11:44:52.491570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: DEBUG nova.api.openstack.wsgi [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Returning 404 to user: Instance 53b2248f-a334-4863-99c7-efb97e83d5ba could not be found. {{(pid=120584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 11:44:52.491570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO nova.api.openstack.requestlog [None req-4d68d908-7474-4e67-a40e-6a9470df2e03 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba" status: 404 len: 111 microversion: 2.1 time: 0.028977 Aug 17 11:44:52.491570 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: [pid: 120584|app: 0|req: 619/1247] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 11:44:52 2022] GET /compute/v2.1/servers/53b2248f-a334-4863-99c7-efb97e83d5ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 11:44:53.799975 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: DEBUG nova.api.openstack.wsgi [None req-95b01548-21e8-4db6-8b87-ab472a7daf26 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] Calling method '.version_select at 0x7f9044243790>' {{(pid=120583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 11:44:53.826085 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO nova.api.openstack.requestlog [None req-95b01548-21e8-4db6-8b87-ab472a7daf26 tempest-TestVolumeBootPattern-161977318 tempest-TestVolumeBootPattern-161977318-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1696160650" status: 202 len: 0 microversion: 2.1 time: 0.030003 Aug 17 11:44:53.826662 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: [pid: 120583|app: 0|req: 629/1248] 10.222.0.15 () {58 vars in 1263 bytes} [Wed Aug 17 11:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1696160650 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 11:46:26.277800 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:46:26.278520 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:46:49.620860 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:46:49.621549 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:46:54.006183 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:46:54.007023 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:46:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:47:35.304612 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:47:35.305716 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:48:08.498520 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:48:08.499511 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:48:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:48:13.845290 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:48:13.846306 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:49:46.288273 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:49:46.289182 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:49:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:50:09.630310 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:50:09.631249 dv-cinder-853450-1-iscsi devstack@n-api.service[120583]: Wed Aug 17 11:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 11:50:14.017151 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 11:50:14.018054 dv-cinder-853450-1-iscsi devstack@n-api.service[120584]: Wed Aug 17 11:50:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!